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ABSTRACT 

The relationship of measure* ot academic ability and 
grades with high level accomplishment was examined by 

, reviewing a wide ranging literature. This literature included 
studies ot .the highly creative, scientists and technicians, 
physicians, high- -and middle-level managers, and high 
school- and college students. The Terman studies of the 
gifted were, also reviewed. Finally, studies uf occupational 

^ attainment and income were exanyned. A very wide variety 
ot criteria were used in these studies. Ih general, the studies 
demonstrated low positive relationships between academic 
aptitude and/or grades and accomplishment. The closer 
the content ot the measure of academic aptitude to the 
demands of the field, the stronger the relationship. 



INTRODUCTION 

Skepticism about the value uf academic ability and 
academic success has grown in recent years. Increasing 
numbers ot researchers, professional psydiologistSc and 
laymen have questioned the importance of high grades and 
high scores on academic ability tests, boubts have been 
greatest about the role of academic talent in high-level or 
creative accomplishment. The purpose of this review is to 
examine the research evidence about the relationship 
between measures of academic ability and high-level 
accomplishment. 

It is important to understand the relationship because 
admission to many colleges is based primarily on academic 
ability. Academic ability is also a prime consideration 'in 
life award of scholarships and financial aid. Finally, 
academic ability and success are often considerations^ 
* hiring people lor jobs in industry, education, alid govern- 
ment. To justify these practices, it needs to be shown that 
selecticfo on academic ability leads to the choice ofpcople 
ot above average potential who will later contribute to. 
their field or position. 

Why should we expect a relationship between acallcmk 
■ ability aridjor grades' "and real-life accomplishment? 
Although this is a straightforward question, fiigre 
are very few" direct answers to it. liven wViter^ such jiN^ 
lletrnstein in IQ. in the Meritocracy do not discuss the 
logic *bchmd the relationship, although they Jiscuss a good , 
many studies. More often than not the answers or logic are 
presumed and not spejled out. Perhaps the most basi*. 
assumption is that academic ability *piays a large or at least 
contributing, role in success in most human activities. The 
ordinary person might express this as "you've got to be'* 
smart to do a realty good job or^ to get ahead"~with 
".smart" usually meaning that a person would do well in 
schoq||0r would havf skills that would lead him or her to 
score high on a test of academic ability. In fact, Duncan, 
Featherman, and Duncan (1972) obtained a correlation of 
.9' between the prestige ratings pf 47 occupations and 
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ratings of the amount of intelligence each occupation was 
believed to demand. This belief may be reasonable, since 
most attainments arc to some degree dependent on the 
ability to read, understand, and analy/c written materials, 
an/ on knowledge and understanding of mathematical 
concepts such as those represented in academic ability 
11 tests, and the classroom. An executive who, rises rapidly in 
a company, an engineer who Files a patent, or a writer who 
publishes a story ar<?fisually thought tt) be^'smarf in the 
sense just described. Put mure formally, it is assumed that 
high-level accomplishment includes intellectual demands for 
its attainment that require a. fairly high level of academic 
ability. The person with high Academic talent should thus 
be able to attain more than the person with little academic 
talent. ^ f 

* , To a large degre'e tljjs idea is implicit in grading in 
schools and colleges. The student who does v/ell in the 
classroom is exprected to be able to do*wcll in real-life 
situations. The classes and curriciilums are designed^ 0 
prepare students to function as j'citi/cn and worker in 
the general society and in speciFic occupations and pro- 
fessions. Thus, tht students who do well in class should also 
generally do w^ll in the social roles and occupational duties 
for which thesfc classes have prepared them. 

From th/s it follows that the students who will be- 
jnost likely to succeed in society and in particular*occupa- 
tions and professions are those who have the most academic 
talent and who have had the greatest success in academic 
work. Consequently, admission to colleges and professional 
schools is^ based primarily .on measures of academic ability 
and records of previous grades. Again, the basic assumption 
of admissions policies is that the students with the greatest 
academic ability and accomplishment arc the most likely to 
do well in coursework, and consequently in society and in 

* their occupations. Likewise, selection for many jobs is also 
based to a large degree on measures or records of academic 
talents. 

Thus, the assumption that academic ability is an im- 
portant, perhaps even required; element in human accom- 
plishment is reflected in the popular culture, the cduca 
tional system, admissions practices, and employment 
f selection. > ^ 

Related to this pervasive view of the role of academic 
taleirt is the mciitocratic belief that academic talent should 
„ be a primary 'reason for admission to schools and careers 
and 'for advancement in those area$ : That is, it is much 
inoie preferable that admission and promotion decisions be 
based on academic abil'ty* rather thafl on the accidents of 
family, health, ethnic background t religion, or neighbor 
^ hood. This policy seems fairer to individuals, encourages 
• healthy, competition, and results in \the most able holding 
\ positions of responsibility, in our society. Again this belief is 
' based on the* idea that academic ability is important in 
successful functioning in high level roles in our society. 
* Why should we expect tojind^ little relationship 
between academic ability (in J real-life accomplishment 9 

V 

I 



Although flu klca that acadcink ability is important* lit 
many it nut most high level accomplishments, *s pervasive 
and persuasive, there aje arguments |ig«.inst finding Mich 
d relationship. The* first stems from jjie tact of the sheei 
diversity and specificity uf human activities. It seems un 
reasonable* to expect academic ability to be highly related 
to success in such divergent aieas as management, leader 
ship, community service, icligion, music, technical woik, 
scientific research, artistic work, literary work, dramatic , 
activity . journalism, etc., Experts within each of these areas 
show even greater differentiation. For example, literary 
work in different areas is said to involve very different skills 
(e.g., writing shoit stories is different from writing topical . 
magazine articles', which is different from writing novels, 
which is different from writing books on tactual mitters, 
which is different from writing sdfolarly books, etc.). 
Editing these different types of writing also involves dif- 
ferent kinds of skills, as da producing them and publishing 
ind'promoting them. ' 

As this last example suggests, human Activities arc 
also sit nationally specific. An executive may Jo quite well 
in one company and poorly in another or may do well o( 
poorly even in the same company depundmg on the details 
of his or her position, the outcome of a fevv key projects, 
the quality of subordinates* work, or the character of 
superiors. There arc many stones of scientific discoveries 
* that were dependent as much on accident as on the ability 
of the Scientist. In many cases, accomplishment may be 
-rtjue to the right person being in the right place at the right 
time. Thus, given equally able and equally trained people, 
accomplishment may be dependent on the specific situa- 
tions peujjj^ find themselves in. In sum, people do so many 
tlnngs.in so many contexts, that it may be unreasonable to 
expect academic ability to be highly related to attainment 
in every situation. 

Another reason for expecting little relationship between 
academic ability and high-level accomplishment *lics in 
the definitions and criteria of accomplishment. Accomplish- 
ment in many areas is a complex, multtfacctcd thing. Tor 
, example, Crooks and Campbell (1974), used over 30 mea- 
sures as criteria of managerial success, and found that they, 
were only moderately intercorrelated. Taylor and his asso- 
ciates used 77 measures to* define physician performance 
(Price ct al„ 1973). Again the measures and factors were 
not highly mteirelated. Likewise, many criteria of success 
have ambiguous meanings. For example, annual income has 
been used as a. criterion of the overall success of college 
graduates. This criterion might appear to be clear, objective, 
and applicable to everyone. However, many professions 
such tfc the clergy and elementary school teaching are low 
paying, conversely, having a high income may be due to 
^pmc lucky investments, inheritances, working in higlt w 
profit businesses such as oil, or positions in family busi 
n esses. Furthermore, it would be difficult to argue that* a 
lawyel serving most of the citizens of a small town who 
earned 520,000 a year was less "successful'* than a class- 



mate who worked in bond trance turns on Wall Street and 
earned S 100,000. Other accomplishment* aie so rare as to 
cull into question then applicability ado** a profession. 
For example, several surveys of Ph.D. psychologists Ijavc 
found that most psychologies have never published an 
article. Even within* colleges aruj universities, Ladd and 
Lipset (1975) found that 29 percent of faculty members 
had uevei published an article (iicaily hall had published 
tewei than thiee) and 59 peicent had never published a 
book (8o percent had published lewei ihan thiee). In con- 
tiast, only 9 percent had published 31 or moie articles and 
only 6 percent liad published 5 -or more books. 

Other researchers have argued that the idea of a, single 
dominant talent, 4 suJi as that represented in academic 
ability, is wrong. They contend that there are many other 
hunuui^a{f>t^ilities that playa role in human performance. 
Thurstoiie (1938),^for example, used factor analysis to 
identify seven basic aptitudes. The United States Employ- 
ment Service faetor-analy/cd a vast number of tests, and 
located and measured nine factors which were then related 
tu the requirements for occupations in the Dktiotidry of 
Occupational TitLs. Finally, Guilford (1968) has proposed 
a model of the "structure of the intellect" that includes 
120 different factors, the majority of which he chums to 
have demonstiated to exist. Whatever is the most accurate 
way to describe human abilities, it is clear that academic 
capacity is only part of the possible range of abilities. 
Whether it pjays the dominant role inhuman accomplish-, 
inent is a matter of debate. In any case, in those situations 
where other abilities play a large lole, it #iay bedifficult 
to show the independent effect of academic ability^ 1 

A not he j limitation of the studies icyicwcd here is the 
length of time between the assessment of academic talent 
and the assessment of accomplishment. For example, an 
investigator may attempt to relate grades in college to 
income or performaiu^ in a piofcssion 40 or 15 years later. 
Obviously many things cart* happen in 10 oi* 15 years to 
affect an individual's career. The choice of employers, 
region, and spouse ^an have an influence as can accidents, 
sickness, and personal problems. There are many non- 
acudcmic influences even within a specialized profession. 
Tor example, a physician's career can be influenced by his 
or her choice of specialization, area of practice, hospital 
or laboTatory, partners, etc. Thus, the longer the time 
following the assessment of academic talent, the greater 
role life circumstances can play, and the lower the relation- 
ship with accomplishment. Of couise, if it is true that once 
people are shown to be ^mait" in school o» college, then 
they will, continue to make "smart" decisions throughout 
then lives and will generally perform better than other 
people, and these circumstances will not have a very pro- 
nounced effect on their careers. * 

Another, more technical reason for expecting little dc- > 
monstrablc relationship between academic ability^and 
accomplishment is the statistical inadequacy and unrcliabil- 
.i ity of the criteria. As suggested earlier* the distributions of 



many criteria of accomplishment may be highly skewed, 
4 others arc categorical, such as winning a professional prize 
or not; and .still others represent a summation of very 
diftercnt behaviors, so their meaning and stability is ques- % 
tionable. Many criteria are quite unreliable. For example, 
/'superiors* ratings" are sometime* bdsed on the ratings 6f 
only a single person or are summations of ratings of people 
who have very different degrees of experience with-the in- 
dividual being rated. Other criteria are based on inadequate 
records and other sources of data that adversely affect 
tlfcir reliability. The important point is that the lower 
the reliability oi tlfe criterion the lowei the degree to which 
it can be predicted. In many of the studies reviewed here 
the criteria have moderate reliability at besl, limiting the 
degree to which ^academic ability can be shown" to be 
related. 

Another technical limitation is the range of academic 
ability present in a shidy^arflpIeTThe narrower the lange of 
academic talent, the lower the relationship that can be 
demonstrated between academic ability and the criterion. 
Consider, tor example, a study of the career successes of 
. Phi Beta Kaj)pa recipients. Since the students all had 
extremely Jngh grades it would be difficult to distinguish 
between very successful and less successful students on the 
basis of grades. In contrast, a study of the earear successes 
of an entire college elasS would allow a broad range of 
academic talent to be studied and students cduld be dis- 
tinguished on the basis of grades. Thus, to be able to show 
a very strong relationship between academic ability or 
grades and accomplishment a reasonably wide range of 
academic talent is required, something that is seldom the 
case in the studies reviewed here. 

The effects of restriction of range on the correlation 
ean.be quite dramatic. For example, if the actual correla- 
tion across a tolal gro'up were *30 and only the top half of 
the distribution were selected, then the correlation found 
would be and if only the top 10 percent were selected, 
then the correlation found would be .12. Most professionals 
have been selected for college, graduated from college, 
admitted to professional school, and graduated from 
professional school, all largely on the basis of their academ- 
ic performance. Thus, those who<pnter a profession have 
already been selected for academic talent several times, 
each time at a higher level. The result is that most pro- 
fessions include a rather narro\V~range of academic talent. 
Similarly, many companies seject tliei^taff at least partly 
on the basu of their academfc record, some also use their 
• own ability tests. The result here is also a-narrqjver range of 
academic talent. . ^ * 

Another technical factor limiting the'demonstrated tq/ 
lationship between academic ability and ac^qmplish/nent is 
the small size of many study samples and the limitations.of 
statistical tests for demonstrating relationships, This is due 
to a basic element of statistical procedures, tliat their 
effectiveness is dependent on the size of the sample. A 
statistical procedure has more "power" to correctly detect 
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a relationship as the sample si/c increases Witlv small 
samples this power is quite limited, so that true relation- 
ships may not be detected and thus the incorrect conclu- 
sion readied that there is no* relationship. Unfortunately, , 
many of the studies of the relationship between academic ^ 
talent and success arc based on small samples, so that the 
studies may conclude that there is no relationship when in 
fact there is one. (The concept of power, as used her*., is 
somewhat technical, the reader is referred to Trattner 
and O'Leary, 1980.)JFor example, if the actual correlation 
is .30, a researcher would correctly detect a significant 
correlation (p<,05) only 54 percent of the time with anA f 
of 50, and 85 percent of the time witltan «Y of 100. 

Anoihci technical problem is that admissions decisions 
tend to be compensatory (Dawes, 1971). That js, when an 
applicant is low in one admissions measure, he or "she may 
be admitted on the basis of "high standing on another. For^ 
example, applicants to graduate school who have very low 
undergraduate grades will be admitted only if they have 
very high aptitude test scores, and vice versa. If these S~ 
individuals arc then successful in graduite work, any study 
relating their undergraduate grades or test scores to success 
may show a small or even a negative relationship This may 
be especially ciitical when tliCL criterion is some sort of 
creative or high-level accomplishment. For example, appli- 
cants with both low undergraduate grades and low test 
scores may 6e adnu'ttcc) to a chemistry program if thcx have 
already shown signs of scientific promise (e.g., by publish- 
ing articles on their own original research). Since the best, 
predictor of later high-level accomplishment is earlier 
accomplishment in the same area, a study of the relation- 
ship between'grades, aptitude test scores, and the scientific 
achievements of the graduates of the chemistry program 
may showlittlc relationship/ 

Finally ah argument can be made that to the extent 
education is successful in bringing students up to a common 
standard of competence, the more difficult it is to demon- 
strate a relationship between academic ability and accom- 
plishment. That is, when an educational program*- for 
example; in a profession like medicine effectively prepares 
ail its students for the demands of a particular occupatian • 
' or profession, it "equalizes" the differences in the academic 
ability of the students. If all the students are prepared to 
meet successfully the intellectual and personal demands of 
occupational or professional work, then the differences in 
.* the degree of their success are likely to be (Jue not to their 
academic ability to master art academic program but to 
other factors, such as specific skills and personal charac- 
teristics. Of course, not all programs can be completely 
effective, so the possible influence of' academic talent is 
still present, however, to the degree they are effective, the 
more difficult it is to demonstrate its potential role. * . 

In sum, there are many conceptual and technical 
reasoJ/ to expect to find little relationship between 
academic ability and accomplishment. Whether the in- ^ * 
fluences that would limit the degrct of the relationship 



aic strong enough to musk the kind of relationship 
expected, bctdu.se, ui tla icasons discdssed earlier, is an 
important concern of this review. Disentangling the limiting 
influences to reach an estimate, of the true lolationship 
is the ehief work of the review. 

Methodology 

Because the Vea of high-le^vel accoinphshnrcnt is so broad, 
extensive efforts were required to uncover the materials 
eventually leviewed. First an ERIC system search was made 
for studies relating accomplishment, achievement, or crea* 
tivity with grades, academic ability, or test scores. Then a 
systematic search was made [\\io\i%\\Psy etiological Abstracts 
and College Student Personnel Abstracts on the same 
topics. Finally a systematic review of every issue ol 19 
journals was conducted for'tlje years 1900 through 1%2. 
These journals were: 

American Educational Research Journal 

American Journal of Sociology * , 

American Sociological Review 

Applied Psychological Measurement 
~ College and Unh>ersit\*» 

Educational and Psychological Measurement 

Intelligence 

Journal of Applied Psychology 

Journal of College Shident Personnel 

Journal of Counseling Psychology 
* Journal of Creative Behaviorf 

Journal of Educational Measurement 

Journal of Educational Psychology * 

Journal of Human Resources 

Journal of Vocational Behavior 

Measurement and Evaluation in Guidance # 

Personnel Psychology 

Research in Higher Education 

Sociology of Education 
* .In addition, the research reports of organizations such 
as Educational Testing Service (ETS), the American College 
Testing Program, and the American Council on Education 
were reviewed for research result^ relevant to- the topic. 
Finally, the books dealing with creativity^ accomplishment, 
success, and human,performance in the ETS, Rider College, 
and Princeton University libraries were examined. When 
any article or report of research was uncovered, the refcr*"^ 
ences to other literature were also examined. Any other 
reference that also seemed to deal with the topic was 
looked up. Thus, eventual!), a reasonably thorough exam 
uiation of the available literature was compjeted. However, 
in inany cases tljis was just the beginning. The results of 
interest we're often buried in obscure, hard-to«find technical 
reports or were hidden away in appendixes. Since many of 
the articles were not mainly concerned with the question 
of the relationship between academic talent and accom- 
plishment, it was necessary to review carefully a wide range 
of articles that appeared potentially relevant to the topic. 



Only the studies which included some real-life accom- 
plishment or creative behavioi wcic included in this {ev lew. 
Studies which concentrated on \ieutivc personality pro- 
flics** and other\iiata which dc not demonstrate actual 
achievement were excluded. Studies of children were also 
excluded, since few children are capable of attainnientsof 
general social value. Although, studies of the personality 
clnu&tcristics associated, with accomplishment are im- 
portant (e.g., Delias, and Gaier, 1970; Golan, 1963), the 
personality traits pf •achieving individuals will be discussed 
only when they shed light on the question of the relation- 
ships of real life accomplishment and acadcnuVability, 

The subject of this review is related to the studies of 
the relationship of creativity and intelligence. It differs 
from those studies in its concentration on real-life accom- 
plishment. Most of the creativity intelligence studies have 
only examined the correlation between tests, of creativity 
and tests of intelligence. Unfortunately, few "creativity 
tests'* have been validated against real-life criteria of crea- 
tive accomplishment, and when they have, they have done 
poorly (Baird, 1972a, 1972b; Crockenberg, 1972). There is 
a large difference between a child's ability to think of 20 
uses .for a brick, and the publication in a scientific journal 
of an article describing the results of research. 

Diffejent measures of'academic ability and success were 
used in the^studies. In most cases, the measure was an 
academic admission test or grades received in an academic 
institution. In othet cases, the measure used v/as a high-level 
verbal aptitude 'test, and in still others, an intelligence test. 
The Tatter were included because most intelligence tests are 
ultimately validated against grades or some Q{hcy form of 
academic success. 

As a recent review of over 300 references on intel- 
ligence testing (Joseph, \911) concludes: 

It appears that the present testing tecliniques-ciifyloyed 
in, test construction und methodology in flic United 
States have been derived from and given impetus by 
Binefs original scale of 1905. This scale and his others 
which followed (1908, 1911) were a reflection of: 
school related abilities and not to be used to get at any 
congenital or acquired determination of the deficiencies 
reflecte'd in the test results (Binet, 1908; Goodenougli, 
' ji 1969; Freeman, 1955; Edwards, 1971). The testing 
movement in America to follow (Goddard, 1910; 
Terman, 1961; Yerkes, 1915; Wechsler, 1939; Per- 
formance Testing, 1917; Group Testing, 1917; etc.) 
all seem to have built more or less on the basic Binct 
model (both theoretically and methodologically) and 
thus the tests as derived and validated against the 
original and revised Binet Scales, did then, ajid still 
do, reflect what the Binct scales reflected, higher 
mental processes presumed to comprise intelligence' 
as it is reflected in a school environment (Binet, 1908; 
GoodenoOfch, 1949; Edward?, 1971; Zach, 1972). 
(p. 80-8 1) 

Making much the same point. Auastasi (1976) has 
written: 



Typical intclltgviKv tests designed for use in our culture 
'with school a$c children or adult* measure largely 
verbal abilities, to a lesser degree ,thcy also cover abili 
ties to deal with numerical and other abstract symbols. 
These are abilities that predominate in school learning. 
Most intelligence tests can therefore be regarded as 
measures of scholastic aptitude, (p. 350) 

Thus, some studies which relate intelligence scores to *« 
attainment will be reviewed, along with those irSing tests 
that are clearly measures of 'academic ability. 

The most difficult problem in tluwrca is to define the 
criteria of "success." A great variety of criteria have been 
used with nnTny ditlerent definitions, even within the same 
category. For example, the criterion of scientific publica- 
tions has been studied in a number of vvay^ and is the 
i subject of a small literature. The measures usc\l have in- 
' eluded sell-reports of publications, counts from vita, 
weighted count*, counts in various journals,, citations to 
articles, and indices of citations per article, l^oyvever, as 
diverse as these criteria are, they can be arranged in^a 
general order of significance and clarity as indicators of 
"success" and the research related to them similarly 
arranged. 

Tb*: plan of this review is to discuss the criteria and 
research in an order ranging from those most clearly 
representing high-level achievement to those representing 
general "success." First to be discussed will be the studies 
of the fiighly creative conducted by the Institute for Per 
* sonahty Assessment and Research at Berkeley. Next, the 
work of scientists and physicians will be considered. The 
literature on success in the upper levels of business and 
industry will then be examined. Then we shall turn to the 
stuJies ot the creative and significant accomplishments ^>f 
college and high school students. Studies of general 
"success/-' including sociological studies of occupational 
attainment, will be examined in the following section. 
Finally, the Terman studies of the lives of individuals • 
with very high Stanford-Binet fQ's will be examined. 
TluJn the implications of this research, along with research 
into the natule ofhuman abilities and attainment, will be , 
discussed. 



STUDIES OF 

HIGHLY CREATIVE INDIVIDUALS 

A group of studies which are directly related t ) the ques- 
tion of the relationship of academic ability to high-level 
aceomplishmpnt are those concerning highly creative 
individuals. Several research programs have been devoted to 
this question, especially the Institute for Personality Assess- . 
* ment and Research at the University of California at • 
Berkeley, which conducted a series of studies of highly 
creative individuals in the fields of architecture, inathe» 
matics, suentifk research, and writing. The samples, and 
the criteria used to select these.groups, have been described 
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by Barron (1965, 1969). The criterion was usually peer 
ratings b^sed on the individual's accomplishment*. In archi 
tecture, for example, afi initial list t of names was con- 
structed from the names nominated as the 40 most creative i 
architects in the United States.by five senior professors of 
architecture at-Berkeley. The individuals selected were also 
rated by. 1 Editors of major architectural journals. Finally, 
the architects who participated in the sample ranked each 
other. A comparison group of "representative architects" 
was also selected from listings in the directory of* Archi- m 
tuts. This group matched the nominees in age and geo 
graphical area of practice. All the names of both the crea 
tive and representative architects were cast 'onto a single 
list which was sent to 19 professors of architecture 
throughout the country, the original group of 5 professors, 
an.d 6 editors of architectural journals. All the names were 
ranked on * seven-point Scale in terms of creativity. The 
"creative" group received significantly and markedly higher 
ratings. The latter .were invited to the Institute at Berkeley , 
where they were subject to intense assessment, as were the 
creative members of the samples in other fields. 

The importance of these studies is that the definition of 
creativity and accomplishment was carefully constructed, 
validated, and set at a high level. Only those who had made 
trul> significant contributions to a field were defined as 
creative, those who were merely produce were exclude J. 
By calling on expert judgment within each field, the groups 
identified almost certainly included the most important 
figures in tlie fields. This definition would probably satisfy 
even the most skeptical within those fields. j/ 

In some cases "representative 0 groups were also irfvited 
to the lfve-in assessment, but in most cases they vrcre not. 
Most of the data on the representative groups w t y collected 
by mail. The measure of intelligence used ii> tlie original 
studies was the Terman Concept Mastery Test,p very jjif 
fieult test of vocabulary and analogies, 1 . 

Because of security regulations governing .the Vse of the 
Concept Mastery Test, it eould not*b<5 adnknistcred 
either to the comparison group of wtftcrs or \q the . 
4 comparison groups of architects. The only sample for 
which a truje comparison group is available is the 
Creative Women Mathematician sample, and the ob- 
served difference between the "crcatives" and the 
"representatives 0 among women mathematicians favors 
the former and is statistically/ significant. (Barron, 1965, 
p. 69) * 

However, within tjic creative architects, MacKinnon 
(1962) found that the correlation between Concept 
Mastery Test scores and rated creativity was -.08, and 
Gough (1961) found a similar correlation of -.07 among 
the scientists, results that might be expected, given the 
narrow range of ratings within the creative groups. 

In a description of later research, MacKinnon (1968) 
reported that 

. , . we have returned subsequently to our architects, 
mathematicians, and research scientists and adminis- 
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tered tu as many as were willing to cooperate the 
Weehsler Adult Intelligence Scale. 

We have divided the samples of architects and 

* research scientists into three subsamples, ranging from 
the most creative to the least creative. Each sample of 
mathematicians, one male and one female, has been 
divided- into two groups, a creative group and a com- 
parison group/At tins point, our most striking finding 
is the -lack of any significant difference in IQ among the 
subsamples characterized by different levels of creative- 
ness. The n.«an IQs for the three groups of architects 
are 132, 131, and 130, for the research scientists, 132, 

132, and 132, fur the male mathematicians, 135 and 

133, and for the female mathematicians, 129 and^l33. 
The ranges of IQs are similarly comparable from sub- 
sample to subsample: for architects,* 120-145, 1 17-142, 

• and 1 19-143; for research scientists, 120-141, 121-142, 

•and 114-142; for male mathematicians, 118-152 and 

126-138; and for female mathematicians, 118-140 and 

118-145. (p. 107) 

* * 

MacKinnon and Hall (1972) have reported these results 

in 'more detail along with the results of multiple regression 

analyses using rated crcativit) as the criterion, and con 

eluded that 

. \ . scoring as more intelligent th»n a colleague docs 
not guarantee that one will surpass him in creativeness, 
as data which there is not time to present, in detail 
convincingly demonstrate: in every group the multiple 
regression equation to predict creativity from WAIS 
scores failed to approach significance in cross-valida- 
- tion. In contrast, multiple regression solutions to 
predict the creativity of our subjects frob^the scales 
of the Strong Vocational Interest Blank, the Study 
of Values, the California Psychological Inventory, the 
Mycrs-Briggs Type Indicator, FIRO-B, and the Gougli 
Adjective Check List all cross-validated at the .01 level 
of significance or better (Hall and MacKinnon, 1969). 

Above a given minimal level of intelligence required 
for the successful practice of o«nc*s profession, which in** 
the groups we have studied is quite high, what is most 
importantly determinative of creative performance is 
not a higher level of intelligence per se but particular 
constellations of non-mtcllective traits. They arc the 
fdctufs that make the difference between a successful 
practitioner of a profession and one who practices it 
creatively, (p. 520) 

Thus, the Bcfkclcy studies generally showed that within 

highly creative professions there aie no consistent dif 

ferciiccs in accomplishment related to intelligence. As we 

shall see in the National Merit and Tcrnian results, among 

giuups of academically Jiighty able individuals, the dif 

fciences in accomplishment seemed due to variables other 

than intelligence. liu>vc.er. it should be recmphasked that 

the groups studied at Berkeley are very bright on the 

a\erage. The typical IQ of 132 places these groups in the 

top 2 percent of the adult population. Even the typical 

lowest IQ of 1 19 is at the 89th percentile. Clearly, to enter 
v 
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their professions, these peopje had to haw veiy "high 
academic ability. . , * 

A few other studies htfVe also examined highly creative 
individuals ajid eoinparcd them with their peers v For 
example. Cross, Qattell. and Butcher (1907) compared . 
Sixteen PersonalityFactor Questionnaire (16-PF) responses 
of 63 artists selected for having given clear evidence of un- 
usual talent in drawing or painting witlr 63 controls who 
had approximately equal educations and worked in similar 
settings. They fount! many personality differences, but Ao 
difference on the 16 Pr measure of "intelligence" aft hough 
both groups scoied.quite high on this measure. The creative • 
aitists showed more dominance! sell -sufficiency, and 
bohcmianism, ancL/eai ego strci:gth,.sell-eontrol. discipline, 
and superego. » 

In an., earlier study. Cattcll and Drcvdahl (19*55) asked 
a panel of ex'perts to choose three groups from rosters of 
their professional society members. Tljc groups were emi- 
nent researchers, eminent teachers, and eminent administra- 
tis. As expected, the three groups differed from the 
general population in a number of piedlctable ways, includ- 
ing having a very high group score on "intelligence." Cattcll* 
and Drcvdahl also compared the threc^groups. Researchers 
were more concerned with their internal thoughts 
(schi/othymiaj and more self-sufficient than cither teachers 
or administrators. They also had less ego strength, more^ 
radical attitudes, and more "bohemian concern."" However? 
researchers were not more "intelligent" than administrators 
or teachers. Of course." we should not necessarily assume 
that administrators or^cachersarc any less creative or show 
any lowei level of achievement just because their deco'm 
phshiuents die in an aica irtoie difficult to evaluate. In any 
case, this study docs not show any Jiffciuices in the Intel 
ligencc of the criterion groups. 

% In sum. comparisons of the intelligence of highly crea- 
tive professionals with their peers reveal few difference. 
Of Course, one might not. expect any large differences 
within such highly selective groups. However, there arc con- 
sistently large differences between the creative groups and 
the general population in measures of intelligence. That 
their less c.cativc peers were equally bright suggests that a 
certain level of ability it needed to enter cc.ain fields, but 
that ability may not discriminate within the fields. Incontrast,, 
all of these investigations found'fairly large and consistent 
differences in the personalities and values of the creative 
piofessioiials and then less creative peers. These have been 
summaiizcd by Barron (1965) and MacKinnon and Hall 
(1972). and include high ego strength and emotional 
stability . a stiong need foi independence and autonomy ,a 
high degicc'of contiol of impulse, high personal dominance, 
i ejection of t confoiuuty piessuies in thinking, a detached 
attitude in intcipersoiial lelations, usk tuLu^, and a liking 
foi order and method combined with a fascination with 
disoidcr jnd exceptions." JUdt llicsc kinds of differences 
appear within such highly self and educationally -selected 
individuals suggests that, beyond the level ot ability needed 
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to quality tor various hchk, other characteristics are needed^ 
to attain high levels ot accomplishment. 

This idea is related to the proposition of^vanous investi- 
gators that there is a "threshold" effect in the relationship 
between intelligence and creativity. That is, creativity and - 
intelligence are thought to be related up to sonre 
"ttyeshold" value, s»y, an IQ of 120, above which they are 
independent (fiarron, 1%5). This idea has been criticized 
by McNemar (1964) and, others, and research on the topic 
has not tended to support it. However, it leads to another^ 
conceptualization, that of a "fan-shaped" distribution 
between creativity and* intelligence where "at* the high IQ , 
levels there will be a very wide range of creativity, whereas 
as we go down to average IQ,»and on down to lower levels, 
the scatter tor creativity will be less and less" (McNemar, 
1%4. p. 879). We shall return to this idea later. 



HIGH-LEVEL PROFESSIONALS 

Tlie studies described in the last section were based on very 
distinctive subgroups of high-level professionals, carefully 
selected for their unusual and significant contributions. 
One cannot generalize from these results to all professional 
work without great caution. What is needed is more 
information about the relationship between academic 
ability and accomplishment among more typical high- and 
foiddie-level professional*. This section reviews two types of 
studies of the high and middle-ranges: those using objective 
criteria and those using frtingf Medicine will be treated 
separately as a third group of studies. 

Studies Usirv Objective Criteria 

Probably the clearest criterion in scientific tfrid technical 
performance is publication activity. Although there have 
been some controversies about the technical manner in 
which publications should be used in research studies (e.g., 
Clomcnte and Sturgis, 1974; Cole and Cole, 1967; Drew 
and Karpf, 1975; Porter and Wdlfe, 1975), there is little 
controversy about the basic significance of publication 
activity. The scientific or scholarly journal article is the pri- 
mary avenue of reporting scientific research. Furthermore, 
since journals exercise editorial control over what they 
print, a published, article typically represents a level of 
scientific competence, and frequently a contribution to 
the field. Because of this, many faculty members and pro- 
fesuonal scientists ire evaluated on the basis of the number 
of their publications. 

One of the earliest investigations of predictors of scien- 
tific publications was part of an evaluation of the success 
ot procedures used to select Veterans Administration (VA) 
trainees in psychology. In 1957 Kelley and Goldberg 
(1959) followed up two samples of graduate psychology 
students who had been VA trainees in psychology at the 
University of Michigan in 1947 and 1948. A widevariety of 



test and rating information had b<rf?n collected on them 
when they were graduate students. Scholarly productivity, 
defined as number of listings of publications in Psychologi- 
cal Abstracts, was predicted in the 1947 sample by the 
.Strong Vocational Interest Blank (SVIB) Psychologist scale 
(.33)/ Banker scale (-.29), and several other SVIB scales, 
and by a high-level verbal reasoning test, the Miller Analo- 
gies Test (AS). However, not a single variable correlating 
with scholarly productivity in the 1947 sample was found 
to correlate in the 1948 sample. In fact, there were no sig- 
nificant correlates of productivity in the 1948 sample 

The next inajor study was also an attempt to evaluate 
the success of selection procedures for a special program 
The National Science Foundation (NSF) began its Graduate 
Fellowship Program in 1952. The program was designed to 
support able students in thei^graduaie studies in one of the 
sciences. Under the direction of Calvin Taylor, followed by 
Lindsey Harmon, a continuous research program was 
designed to improve the procedures for selecting NSF 
Fellows. Graduate Record Examinations (GRE) scores and 
college' grades were, part of the selection information. 
Two groups of fellowship applicants were followed up in- 
tensively, the students who had applied in 1955 and in 
1956, when they were college seniors or graduate students 
with one or more years of graduate study. Criteria studied 
in follow-ups included Ph,D, attainment, income, number 
of publications or patents, number of times the applicant's 
works were cited in the literature, and several ratings 
derived from conptiential reports made by thfc applicant's 
colleagues, subordinates, or former professors. Ratings of 
the applicant's overall performance from at least three 
people were sought- in 1965, although in a few cases only 
one rating was obtained. The various criteria were treated 
with sophistication. For example, Creager (1963) developed 
a method to place the applicants in stanine groups, based 
on a coded index of the applicants' later publications and 
patents. The stanine system was important because of the 
skewed distribution of the production of articles and 
patents, a problem noted in the Introduction. 

The various selection variables were correlated with the 
criteria. Within-field correlations seem th$ most appro- 
priate, since t fields which differ on some predictor variables 
may also differ on the criteria. For example, chemistry 
students score high on the GRE-mathematics examination, 
and chemistry is a field with a high average publication 
rat^. When all applicants were combined, there might 
appear to be a greater relation between GRE-mathematics 
scores and publications, simply because fields with different 
publication patterns were combined. In the fields where 
sufficient numbers of cases were available, the analyses 
were also conducted separately by year. 

The results, as reported by Creagar and Harmon (1966), 
are shown in Table 1. The GRE-verbal test was not related 
to income. It was related to the productivity index in three 
of the seven fields, although in two of these, the relation- 
ship did not hold from one year to the next. GRE-verbal 
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Table 1. Correlations of Income, Productivity, and C?fations with Four Predictor Variables* 
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♦Adapted from Creager and Hormqn, 1966* * 

Decimal points have been omitted f # 1 

Coefficients significant at the $% level arc italicized, those significant at the 1,* level are italicized and underlined. 
Columns headed IN.giv )irelations with Income. , - * 

Columns headed PR give correlations with Productivity Stanine. 
Columns headed CI give correlations with Citation Counts (1964 Index). 
Columns headed OA give correlations with Overall Average perforinance ratings. 



was related f j the citation index fbj two years in- biology, 
one year in physics, and for one year in chemistry. It was 
also related to the ratings in biology, engineering, and 
psychology , and for one y car in physics. 

The GRE -quantitative test was related to ^ricomc in 
'mathematics and biology applicants. It was related to 
productivity among the 1956 biologists, the geologists, 
and the 1955 ph> sicists. It was consistently related to the 
citation index in biology, chemistry, and psychology, it 
was inconsistently related in physics. It was related to 
overall rating in biology, engineering, gcolog>, and, in 
consistently, in physics. 

College grade point average was not related to any of 
the criteria except the overstating in biology, chemistry, 
engineering, and, in the 1956 group, in physics, and to 
income in mathematics. This result might be expected be 
cause of the very narrow range in grades. 

The GRE-advanccd tests ar,c discussed last because 
they are strictly speaking less measures of general academic 
aptitude than measures of detailed understanding and 
mastery of each academic, field They ace much more 
narrowly defined and M . . . arc designed to measure mastery 
and comprehension of matcriaL basic to graduate study in 
major fields ...an attempt is made to survey the field 
and tu draw material from widely differing curricula .... 
The Advanced tests emphasize the basic concepts and 
principles uf their subjects and include questions that 
require reasoning, analysis, and decisions based on 
knowledge of these principles/* (Graduate Record Ex 
animations, 1969, p. 5.) The GRE advanced tests wcr* , 



inconsistcnfly^vxehited to income in biology, chemistry, 
and physics. They were related to productivity in every 
field but psychology. They were related to thc«citation 
index in every field except geology. They were related to 
the overall rating in every group except psychology and the 
1955 physics group, 

^Jjt short, measures of academic aptitude were not sig- 
nificantly related to the income criterion in most instances. 
The best predictors of the other criteria were GRE- 
advanced test scores, followed by the GRE-quantitativc 
scores. However, most of the significant correlations were 
moderate. Of course, the correlations arc almost certainly 
attenuated because of the restriction of range in academic 
ability. However, the restriction in range did not seem to 
affect the correlations of the GRL-advanccd field tests. 
(Of 40 correlations between the criteria and the GRE- 
advanccd tcife 28, or 70 percent, were significant.) Thus, 
general academic ability did not seem to. be as highly # 
related to^ the criteria as did knowledge of a specific field. 
We shall discuss this point more fully later. 

Using a^ more complex criterion, W. A. Owens (1969) 
collected information on the 19o4 accomplishments and 
performance of 931 engineering alumni who were originally 
administered a variety of instruments in 1955 when they 
were (in most cases) juniors. The subjects ,wcre enrolled 
in a wide variety of/institutions across thq* country . The 
original instruments included a biographical information 
blanks interest measures, an application of mechanisms x 
test, a power source apparatus test, and, for 457 members 
of the sample* the American Council on Education (ACE) 
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Psychological Examination, a measure of academic ability. 
The criterion was a summed score based on professional 
papers, professional jotirnal publications/ development 
or improvement of products or processes^and, given most 
weight, patents held, pending, or disclosed. Although the 
ACE examnytion had no significant relation with this 
criterion, sctotjI of the other measures had significant, if 
small, relationships. In addition self-reported "academic 
achievement" -consisting of ranking high in one's class, 
being a member of an honor society, being a scholarship 
winner, ctc-had a significant correlation of -A9 with the 
criterion. , 

In a small study within n very specialized area^Gertler 
and Meltzer (1970) developed an equation from a study of 
47 Ph.D. alumni of the industrial relations program 
.Carnegie-Mellon University. They predicted the per- 
formance of the Ph.D.s during their careers in research, 
using information available 1 at the time application^ were 
submitted. The researchers developed an index of research 
publications, adjusted for the quality of the publication, 
as their measure of performance. Undergraduate grades, age 
at timC of application, and previous graduate training 
appeared to be important for the prediction. Scores on 
Standardized tests (GRE and the Admission Test for 
Graduate Study in Business) did not discriminate within 
the range covered by the sample! They interpreted grades 
as a measure of the motivation to succeed. 

Folger, frstin, and Bayer (1970) 1 studied the largest 
sample of any reviewed here. 6,300 doctorate recipients 
♦ (1957-1959) in mathematics/statistics, physics, chemistry, % 
biochemistry, and psychology who responded to the 1964 
National Register file of recent doctorates. The criterion 
measures were number of citations to each sample mem- 
ber's works in 1964 and 1965. By searching high school 
records, ability measures were located for many in the 
sample. The correlations between these measures and cita- 
tion counts in the above fields were mathematics/statistics, 
.04; physics, .10; chemistry, .07, biochemistry, .04, and 
psychology, .07. The correlation was significant only in 
physics. Quality of graduate department and tim* taken 
to attain the degree were correlated with citations. This 
study was limited by the availability and comparability of 
, ability tests, the fact that they had to be equated, the long 
interval between ^the testing and the criterion, and the 
relatively short period of professional life covered, all of 
which would attenuate the size of the correlations. How- 
ever it is based on a large sample, and uses the criterion of 
citations, which some researchers have recommended as the 
best single measure t)f scientific impact. 

One possible explanation for the lo.w correlations 
between academic ability and productivity measures is 
that specialties within professions will make different 
uses of their abilities. For example, Marston (1971) found 
III University ol "Southern California PluD.s in psychology 
who graduated between 1952 and 1966. Marston correlated 
their scores with rfieir Psychological Abstracts count as 



measured by weighted •mean number of publications per 
year. Combined GRE-verbal and GRE-quantitative' scores 
correlated -.05 among clinical Ph.D.s and .18 among non- 
clinical Ph.D.s. Because of skewness in the distribution of 
the criteria, point-biserial correlations were also run. All 
were nonsignificant. Weitzman (1972) suggested that skew- 
ness may be because only the few very high scorers 
published. This possibility was investigated by Schrader 
and b) Clark and Centra irf studies to be described later. 
Creagar, in the stady described earlier, also analyzed his 

* sample by type of -employment: academic, industrial, and 
government. Although there was a slight tendency for the 
correlation in iiftlustry to be fawer, the overall patterns 
were very similar to those described before. Thus, there 
is little evidence that results are very different in subfields. 

Two studies with similar drawbacks and advantages 
were conducted by Kaufman and Hansen and Nevjahr. 
Kaufman (1972) studied 1 10 engineers from three technical 
organizations. They were administered an engineering 
achievement test (similar to the Undergraduate Program 
. Field Tests in Engineering) shortly after tl)*y obtained their 
college degrees. They were followed up approximately 
14 years later; and data from the first eight years, middle 
three years, and last three years were analyzed. Criteria 
were claimed range of area of accomplishment (diversity) 
and competence in those areas (competence), supervisory 
ratings (performance), number of publications, and number 
of patents. 

Achievement test scores were related to the number of 
patents in all three periods with correlations of .29, .34, 
and .31, to papers produced in the first period ( 19) and the 
third (.23) but were unrelated to any of the ratings of 
coi>$etence. In a reduced sample of 32 engineers, scores 
were related to claimed competence (.38). 

In the second study, 115 students who were enrolled 
in the Science Honors Program (for high school students) 
at Columbia in 1*959 tQok the Pre-Engineering Ability Test 
(P/fT) in addition to the engineering achievement te$t. 

* Hanseii and Nevjahr (1973) found that the PAT predicted 
the number of publications reported in a follow-up 12 years 
later, with a correlation of .26 with the mathematics test on 
the PAT and .31 with the achievement test. It also pre- 
dicted whether the^tudents obtained advanced degrees 

Schrader (1978) conducted a study that carefully * 
defined both the sample and the criteria. Schrader studied 
a sample of psychologists who had earned a doctorate in 
psychology in fc 1963-64, who had earned a bachelor's degree 
between 1954 and 1961, and who had retrievable test 
scores either on the SAT or on Hie aptitude test and an 
& advanced test of the GRE. The final sample sizes were 128 
. for SAT scores and 155 for GRE scores. . 

Measures of attainment included citation counts ob- 
tained frohi the Social Sciences Citation Index (SSCI) and 
the Annual Review of Psychology, and publication counts 
obtained from Psychological Abstracts, all based on entries 
between 1972 and 1975. Other criteria included number of 



time* Uk Mibjcvt was lifted as a first author, and election tu 
fellow status in the American Psychological Association 
(AP'A). The rating of the graduate facult> in psychology for 
each psychologist's doctoral university as reported by 
Cartter (1966) wa$ included in the study, along with 
various other biographical variables. 

Since the distribution of SSCI citations was skewed, 
Schrader included a normalized citation index as well as 
raw number of citations. Schradcr found that although 
SAT verbal Scales were not significantly related to any of 
tli ^ criteria, SAT mathematical scores were correlated 
with normalized SSCI citation counts (.18) and raw counts 
(26). GRF verbal and quantitative scores were signifi 
eantly correlated with most of the criteria, the GRE 
advanced test was also correlated with all of the criteria 
except attaining fellowship in the APA. The correlations for 
GRL verbal, GRE -quantitative, and GRE-advaiiced. rcspec^ 
tively , with each qT the publication and citation criteria, 
were as follows, for SSCI citations (law) .26, .28, and .40, 
for SSCI citations (normalized) .28, .19, and .45, for 
citations in the Annual Review .21, .30, and .32, for total 
Ps\Lfu>loi>LaI Abstracts count .17. .28, and .32. and foi 
publications as first author .15 (not significant), .26. and 
.33. 

Schradcr ah>o examined the distribution of the number 
of publications and citations across score groups. He found 
that the highest score group had the highest number of 
publications and citations, but that the lowest group had 
the next highest number, and the middle group, the lowest. 

The pattern of relationships, with the Advanced test 
having the best correlations with the criteria is similar to 
the results of Crcagar and Harmon. 

Finally, a recent study by Clark and Centra (1982) 
seems to provide the most compiehensive analyses of the 
persona! and situational influences on productivity. Claik 
and Centra studied two samples of doctoral recipients. The 
first was a sample of alumni of Ph. D. progiams in chemis 
try; history, and psychology programs (Clark, Hartnett, 
and Baird. 1976), who had received the doctorate between 
1<H) and 1972 and were followed up in 1975. The second 
. consisted of men and women who had received doctorates 
in 1960 and in 1968 who were followed up in 1973 
(Centra, 1974). The criterion was number of self-reported 
publications. To check on the accuracy of thc^e reports, 
the authors compared the reports of the male alumni in 
psychology who participated in the first study with the / 
number of their entries in Psychological Abstracts. The 
correlation was .84, which seems quite reasonable, since the 
correlation between the count for 1967-1975 with the 
count for 1967 1977 was .96. Furthermore, since /fyt/it^ 
ghat Abstract b does not abstract all journals, it also seems 
reasonable to suppose that many in the sample had pub 
lished in juu:nah> not included in that count. Thus, the self ^ 
report of number of publications appears fairly accurate. 
GRE verbal and quantitative scores were found foi the sub 
jectb in the first sample. Because there were so few women, 
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tficy were excluded from the analysis. The resulting sample 
consisted of 239 chemists, 142 historians, and 221 psy- 
chologists, all of whom had at least one GRE score. In 
chemistry overall, the correlation of number of articles 
and book chapters with GRE-vcrbal was -.02, with GRE- 
quantitative it was -.01 , and with GRE-advanccd it was. 15. 
For only those chemists engaged in research in business or 
government, they were .13, .11, and .05. For all historians, 
these correlations were -.2jk%14.,and .00. For all psy- 
chologists, the correlations wferd -.05, -.02, and .02. 

Clark and Centra also examined the distribution of a 
number of publications by GRL scores.v The distributions 
were essentially flat, wjth no particular trend. In fact, the 
largest number of publications was reported by thc^owcsi 
scoring groups in all three fields. 

In the second sample, GRE scores were found for 94 
respondents in the social sciences, 115 in the biological 
sciences, and 103 in the physical sciences. To create more 
stable variables, certain information was combined. A 
"productivity" measure was constructed by weighing the 
number of articles publfchcd, thcjiumbcr of books as sole 
or senior author, and the number of books as junior author 
or editor. Similarly, an "academic ability" measure was 
constructed by weighing GRE-vcrbal, GRE-quantitativc, 
and GRE-advaiKred scores. There were no significant rela- 
tionships between "productivity" and "academic ability." 

Clark and Centra also used the technique of path 
analysis in both samples tj determine the influences on 
productivity and income. In both studies, for the purpose 
of the analysis, an "academe ability" and a "productivity" 
factor were derived. In the first study, in chemistry* 
academic ability had no relationships (no path coefficient) 
with any other variable, including productivity. In history, 
academic ability had a- coefficient of -.27 with productivity 
and no other variable. In psychology, academic abdity lia<j 
a coefficient of -.21 with productivity and no other 
variable. In the second study, among physical scientists, 
academic ability was related only to the prestige rating of 
the department that awarded the degree to the respondent. 
Among biological scientists, academic ability was unrelated 
to all other variables. Among social scientists, academic 
ability was also related to the prestige of the department 
and had a coefficient of .26 with productivity. 

The most consistent influence on productivity across 
the six samples studied was the nature of the current posi- 
tion, those who were working in positions that emphasized 
research were more productive than those in other posi- 
tions. There were a few, chiefly indirect influences of the 
rated quality of the Ph.D. awarding program. 

These analyses arc important because they show the 
interconnections and structural influences of variables on 
productivity, and thus piovide much more information 
than simple correlations, which may be due to other factors 
than the two variables being related. They show that, in 
these samples, academic ability had at best an inconsistent 
relationship with productivity. However, the samples in 



the first study had been working tor only three Wars, and 
the average number ot publications was low, so' that only 
a tew eases might have altered the correlations consider- 
ably. The samples in the second study lumped together 
fields that may have very different publication patterns, 
e.g., psychology and history were both included in the 
social sciences, but the average number of journal articles 
is much higher in psychology than in history. Tlyis, any 
differences related to academic ability may not appear 
because Uie field differences mask them. 

The studies reviewed here have studied a variety of 
samples, with differing time frames, and were conducted 
tor a variety of purposes. However, several broad condu- 
sions seem warranted. In general, the correlations between" 
measures of general academic ability and publications or 
citations were low to moderate and inconsistent. 

Ihe result that GRL-adtanced tests tended to have the 
highest correlations with the criteria was found in the 
Creagai and*Harmon study and one of the Schrader studies, 
and in some of the Clark and Centra samples. The pattern 
in those studies suggests a general possibility that will 
appear in other studies which will be reviewed in later sec 
Hons, the closer in tune or more similar the test to the 
criterion, the higher will be the correlation. The CRT 
advanced tests measure knowledge ,in a specific field, 
rather than general abilities. Thus, they represent measures 
ot the academic preparation of individuals and, possibly, 
4 their motivation to learn and their interest in a field, all ^ 
qualities that presumably would be related to high level 
professional behavior. 

Ratings of the Performance of Scientists and 
Technicians 

A second group of studies is concerned vvith the general 
professional performance of scientists and technicians, 
as assessed by their superiors or peers. Although ratings 
have various problems (see, e.g., the discussions by 
Anastasi/1976, McCormick and Tiffin, 1980), ihey also 
have several advantages. For example, Anastasi writes of 
ratings as 

... an evaluation of the individual by the rater on the 
basiv^f cumulative, uncontrolled observations of daily 
„ life. Such ratings differ from naturalistic bbservations 
in that the data are accumulated casually and informal- 
ly; they also involve interpretation and judgment, 
rather than simple recording of observations. In con- 
trast to both naturalistic observation and interviews, 
however, they tyjpically cover a longer observation 
period and itjc Jhforniation is obtained under more 
realistic* conditions^ (p. 609) 

Ratings may be especially appropriate for scientists 
and technicians, since they often produce products in the 
form of .'experiments, studies, reports, inventions, or im- 
provements that can be used as one basis for their evalua- 
tion. Thus, the ratings may be made on a more objective 



basis than in some other fields of activity. These ratings 
have slowly increased in sophistication. iFor example, in a 
comprehensive study of engineer^ conducted at Educational 
Testing Service, great effort went \t[to developing and , 
refining the rating scales, but chief reliance was placed 
on an overall rating. 

llelnphill (1963) studied 448 newly hired engineers in 
five companies vfhosc performance was rated by their 
-Supervisors after they had been on the job for two years/ 
In the total sample, overall performance ratings were cor- 
related .19 with a verbal reasoning test, although they were 
not correlated with three other tests. The correlation of 
verbal reasoning varied by type of work, it was not signifi- 
cant with ratings of those who were developing and 
utilizing ' personnel/ but i it was .32 with those who 
persuaded and negotiated with others. In two other samples 
of experiencqd engineers, pcrfotmanee ratings were cor 
related with a numerical relations test in two of seven areas 
of specialization. 1 * * 

In a study by Jones (1964), 25 manage^ rated 88 in 
dustnal scientists and technologists in a large company, 
using a weighted creativity rating scale (Sprecher, 1954). 
(It correlated .88' with a simple global rating of creativity .) 
A logical reasoning test (rOlMid.a mathematical reason * 
ing test (r=.29) were related to the criterion as was an 
ideational fluency test (r=.33). 

Kaufman (1972), in a study reviewed in the last section, 
included supervisors' ratings of the performance of en- 
gineers among several other criteria. Achievement test 
Lores were unrelated to this criterion at any stage of the 
engineers* careers over 14 years. 

"Gough (1976) administered a battery .of tests to 45 • 
professfdnal research scientists, who were also rated on 
creativity by an average of eight peers and two supervisors. 
Then lie standardized and summed the ratings. Their re- 
liability was .77. In another sample, senior honors engineer 
mg students at Beikeley were rated by their professors 
using the same criteria. Among the scientists, neither the 
Minnesota Lngiuoering Analogies Test nor the Concept , 
Mastery Test were correlated with the criterion, but" a 
"scientific-word association^est" was. (This test presented* 
a scientific word, such as "neutron," and asked the subject 
to indicate the first word that came to mind.) In the stu- 
dent sample, the ability tests correlated with professors' 
ratings .34 and .33, respectively. 

An increased level of sophistication is shown in a study 
by South (1974). Tor 130 young engineers, South used 
rating scales developed by factor analysis. These scales 
were correlated with a large number of tests. Various 
academic ability and intelligence tests were positively 
related to communication skill (the correlations ranged * 
from .22 to .30),' and technical knowledge (.25 to .31), 
but negatively related to administrative ability (-.22 to 
-.30), and ".motivation" (-.24 to -.32). 

A more comprehensive approach was used in two 
studies by Muchinsky and Hoyt. Muchinsky and lloyt 
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(1974) followed up engineers who had been freshmen in 
1956, 1957, or 1958 and graduated from 'the College 
of .Engineering at Kansas State University. All had been out 
of college. 5 to 10 years, Supervisors of 127 of the sample 
rated thcpi on 10 traits and gave them an overall rating, 
and a weighted rating was devised. In addition, a rating of 
their beat vocational achievement was made by faculty 
members. The subjects provided data on their salary and 
two self-ratings. The ACE-quantitative scores correlated 
with 3 of the 15 criteria. .26 with the weighted overall 
niting, .37 with rated written communication, and .40 with 
rated persuasiveness. The ACE4inguistic score was un- 
related to all 17 criteria. 

In an cailiei study, Muchinsky and Hoyt (1973) used 
the same sample of engineers and the same criteria but used 
overall grade-point average (GPA); senior GPA, "core^ 
GPA," and "design GPA" as predictors. Although overall 
GPA was related to only one of 15 Criteria, a rating ol^ 
creativity or originality (r=.21), senior GPA was related to 
ratings ot ctcativity or originality (r=.30), the achievement 
rating by faculiy (r=.2S) and overall occupational rating 
(r=.23), core GPA was related to ratings of precision and 
care (r=.17); and- design GPA to salary (r=.26). 

The ^ most careful criterion in the studies reviewed 
here was developed by Andrews (1975), who examined 
the relationship between verbal ability and the quality 
and quantity of scientific output. Data were obtained from 
115 sociologists, psychologists, and medical doctors who 
had directed research projects on the social psychology of 
disease. Andrew* obtained copies of the reports or major 
publication* these scientists had identified a* the, most im- 
portant, they had written abotit ^eir projects. These were 
abstracted and independently lated by one to seven mem- 
bers of the American Sociological Association (median 
of 4.5 raters per project). They were rated on. (1) mnova- 
tivcness, or the degree to which the projects advanced new 
lines of research or theory; and (2) productivity, or the 
extent to which the projects add to knowledge along es 
tabhshed lines of. research* or theory. These ratings wete 
correlated with the scientists' verbal scores on the General 
Aptitude, Test Battery (GATB). Productivity correlated 
-.01 and innovativeness -.09. Andrews did not find art) 
special situations (e.g., among less expeiienced vs. more ex- 
perienced, those in different ' supervisory robs, etc.) in 
which these coi relations were altered. (Andrews does -not 
present the average GATB scores oi their standaid devia 
tion. so it is hard to estimate the ability level of this group.) 

In summary, the evidence on the relationship between 
..adeinic talent and ratings of engineers and scientists was 
mixed. Some of the st\idic~s found some relationship, usual 
ly small, but a few did not. It is striking, however, that foui 
of these studies (Mednick, Cough, Andrews, and Taylor 
and Ellison) reported positive results for some type of 
assessment of creativity. Perhaps, again, when a certain 
level of ability is reached, factors other than academic 
talent become more important for accomplishment. 



Studies in Medicine 

The prediction of success in medicine is treated separately 
for several reasons. Medicine is a Clique profession, com* 
billing science with practice and technical knowledge with 
personal, even intimate, contact with patients. It involves 
complex professional rojes, so i{ represents a challenge to 
the researcher. Finally, it has been and continues to be llic 
subject of many studies. The relationship between medical 
* education and professional duties is being examined in q 
continuous "program of research by the Association of 
American Medical Colleges (AAMC), as well as by several 
other groups*. The results of their investigations are reported 
in a specializedjournal, The Journal of Medical Education, 
and in The Proahtdings of the Annual 'Conference on 
Research in Medical Education sponsored.by the AAMC. , 

Various studies in this literature have been reviewed 
by Cough (1967)! Wingard and Wjlliamson (1973), and 
Cuca, Sakakeeny, and Johnson (1976). One of the bes't 
studies in llfis literature was conducted by Peterson et al. 
(1956). The medical expertise of 88 physicians in general 
m practice in North Carolina Was rated by internists who-ob- 
, served their behavior in their daily office \york. The phy- 
sicians were rated On six dimensions of professional com- 
petence. None of the ratings was significantly related to 
their Medical College Admissions Test (MCAT) scores. 

Howell (1966) contrasted 156 United States Public 
Health Service physicians, who were rated high on official 
(open ended) efficient reports with 156 who were rated 
low. The physicians were employed in a wide variety of 
settings. There were man> significant differences on various 
personality tests, including Adjective Checklist scales, 
California Psychological Inventory scales, and the K scale 
of the Minnesota Multiphasic Personality Inventory, but 
none on two tests of values und several other tests, includ- 
ing tlH MCAT and the Public HcaltJrScrvice Professional 
Examination in medicine. 

In a Itfter study, Howell and Vincent (1967) studied the 
relationship between MCAT Scores and annual supervisory 
ratings and an achievement examination measuring 
academic knowledge of medicine. The correlations bctvVcen 
the MCAT scores and the ratings ranged from -.05 to -.25. 
MC^VT scores were related to medical knowledge test 
scores with correlations ranging from -.05 to .62. 

A number ,of studies of practicing physicians have been 
conducted by a .research group at the University of Utah. 
The studies discussed immediately following, as well as 
later ones, were subsequently described in greater detail 
by Price et al. (1973). This group developed 77 measures of 
on (he job physician performance in three samples. 102 
full time faculty membeis of the College of Medicine at the 
University of Utah (Taylor et a». 19655, 190 certified 
Utah specialists (Richards et al. 1965), and 21 Z general 
practitioners (Price et al. 1964). Premedical GPA, GPA 
for the first two years of medical school, aiid GPA for the 
last two years of medical school were correjated with 



the criteria in the three samples. Only 3 percent of the 
correlations were significant at the 5 , percent level, and 
more of these were negative than positive. 

In a subsequent study (Jacobsen et al. 1965), the Utah 
group studied first a slightly different sample of medical 
'school faculty members (N=61). -Undercracjuate grades '• 
were significantly correlated with 5 of Z5 criteria, the 
respondents* regular review of scientific literature 1 (.29), 
public recognition for contribution (.32), cooperativeness 
in the research project (.40), achievement in education 
(.56). and negatively, teaching responsibilities (-.42) ; 
Medical school grades were significantly and positively cor- 
related with academic orientation-teaching excellence 
(.35), participation iq social organizations (.32), achieve- 
ment in education (,51)»*and negatively correlated with 
academic seniority [-At>)\ and participation in professional 
societies (-.30)., . • 

In a second sample of 242 general practitioners, the 
average correlation, across criteria, was .02 for premedical 
school grades, .03 for grades in the first two years of , 
medical school, and .05 for the last two years of medical, 
school. .However, these averages mask some important*, 
results. All three grade predictors were highly related to 
the "achievement in education" factor (.74, .97, and .95). 
Premedical school grades were positively correlated with ' 
youthfulness in getting degree (.27) and socioeconomic 
status of patient (.23), and negatively correlated with civic 
participation (-.24), keeping abreast of 'medical progress^ 
through courses and professional groups (-.30), and diagf f 
nostic thoroughness (-.21). Grades in the first two yearj, 
of medical school were negatively related to recognition 
*by hospital staff (-.25). Grades in the second two years 
correlated positively with- civic participation * (.20), 
''orthodox success image" (.26), and correlated negatively 
witji youthfulness in getting a Tfcgree (-.24). Score on 
the Medical College Admission Test were also correlated 
with the criteria in this sample. The Verbal score positive- 
1 ' ly predicted the size of the physician's practice (.38), 
and negatively predicted medical referring (-.22), and 
olf-the-job socialization (-.24). The Quantitative score was 
ftegatively related to orthodox success image (-.18), 
medical referring (-.27), and professional stability (*.31). 
The science score was related to the factors of group or 
cbnic practice (-.21), hospital staff recognition (-.20), 
prolonged postgraduate training (.18), off-the-job socializa- 
tion (-.27), afid professional socialization (-.21). 

Altogether, this study suggests the complexity of the 
criteria in a single profession, and shows how measures of 
academic ability and academic su\xc$s can have vaiied re- 
lationships to those criteria*. 

The last research report in the Utah studies (Price et al. 
1973)* summarized several additional studies, which used 
- soijie combined samples and new samples. In the first 
of these later studies, the General Aptitude Test Battery 
(&ATB) scores, grades, and Professional Aptitude Test 
scores of a sample of 31 medical students were related to 



their professional performance as physicians 19 years later. 
Overall only 5 percent of the predictive validity coefficients 
wore significant at the 5, percent level of significance. - 
However, this result may not be surprising, given the length 
of time between the testing and the gathering of the crite- 
rion data. 

In another siud£, the various criteria were summarized 
ynto five performance criteria. In a co'mbined sample of 333 . 
physicians who had graduated from n* Jical school on an 
'average of 1*6 years earlier, pren 4 grades were not 
related to. any of the criteria. Grade- ■ first two years 
of medical school were correlated witn "»iary score 
from the 80 criteria as weighted for discrink .«w.ig superioV 
physicians (.20), as were grades in the last two years (also 
.20). Grades in both medical school periods were correlated 
with judgments of the quality of a portfolio of each physi- ' 
cianY history and accomplishments (/*=.33 for first two 
years, .22 for last two years). Grades in both periods were 
related to a rating, of the physician wh,en his or her name 
was known to the rater (V=.21 for the first two years, .25 
for the last two years), grades in the last two yeafs were 
also related to an "equally weighted" composite (.16). 
When the physicians were grouped by tj;pe of practice, - 
grades did not significantly predict the criteria among^j 
general, practitioners. Amonj* specialists, grades in both 
medical school periods were related to all the criteria 
except a judgment of the quality of their contributions. 
Tfie correlations ranged from .21 for the weighted com- 
posite to .41 with the rating when the. physician's name 
was known to the rater. Grades vfe;e related to the judg- 
ment of quality of their contribution (.35) and the rating 
by name (.32). 

In a second study with this sample, an additional eight 
output criteria were used. An "output composite 11 was 
correjated .21 Vith undergraduate grades and .23 with 
grades in the fifst two years of medical sthool. An index of m 
"high relevance 11 was correlated .24 with grades In the first 
. two years and .20 with grades in the sdcond two years. 

These correlations seem quite 'reasonable, even unex- 
pectedly high when one considers: (1) the variety of the 
sample, which* combined general practitioners, specialists, 
and medical school faculty, (2) 'the average length of time - 
16 years T between the academic performance and the 
criterion data, (3) the combining of very divergent and de- 
tailed criteria, many of which would have no relevance 
to particular physicians, into total scores or ratings. 

Wingard and Williamson (1973) reviewed 7 studies 
relating medical school grades to'the performance of physi- 
cians and 20 related studies in other areas. Criteria ranged 
from ratings of the quality of their technique made by 
internists* to elaborate factor scores. Their conclusion: 
"Although studies in this area are sparse, available research 
findings have demonstrated that little or no correlation 
exists between academic and professional performance" 
(p. 313). They also reviewed research on career perfor- 
mance in related fields and reached the same conclusion 
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Thc> umsidcicd four possible explanations fur the low 
correlation. 

(a) Deficiencies m present grading systems as not 
reflecting qualities needed in real-life work. ' * 

" The role of tfie physician, whether as practitioner, 
Investigator, teacher, or administrator, is basically 
that of the problem-solver the physician must be 
sensitive to problems and be able to collect adequate 
data, conduct analyses, draw conclusions, communicate 
the findings, and organize human, and 'technical re, 

* sources to implement the solutions. Since, with few 
exceptions, grading does not attempt to utilize crite 

' rta of this type, it M likely that grading would be 

* deficient in application, (p, 3 13-314) 

♦ 

(b) The failure of selection procedures to include 
characteristics that arc important in professional careers, 
they point out thdt selection 

. . . procedures may 4 identify only those who are most 
likely to achieve succcs^ in a current educational 
program. Consequently, many students selected, often 
on the oasis of Medical College Admission Test scores, 
have characteristics that may ultimately determine ade-* 
quate performance, for example, professional integrity,, 
concern for people, and the ability to relate and com- 
municate interest in the concerns of the community 
# served by the physician. The fact that such qualifies 
arc rarely weighted heavily in selecting Students for 
medical training or included in the process of student 
evaluation might have a significant effect in distorting 
the relationship between academic and professional per- 
formance, (p. 3.14) ^ 

m (c) Intervening experiences. Physicians (and other pro 
fessionals) hold internships, residencies, and fellowships, 
and obviously have many different kinds of career ex 
perienc.es. These career experiences may have as strong an 
effect as schooling. 

(d)' Grades as indicators of ability . Some medical cdu 
cators claim that grades only assess the potential of 
students' talents for career performance; aehicvement of 
this potential may not bcprcdictablc. 

Thus, according to Wingard and Williamson, there are 
good reasons to believe that medical school grades assess 
behaviors and performances that a're different from those 
that arc important in medical practice. 

It might be argued that this lack of relation is not due 
to differences in the behavior or activities in academic 
and professional settings, but is due to the lestriction of, 
range in the academic ability of physicians arnd medical stu 
dents. Since this argument may be put forward for many of 
the studies reviewed throughout this report, it seems 
reasonable to quote the response of Price ct al. (I973),at 
length: 

Medical school grtdes arc inadequate as guidance or 
predictive tools for later physician performance. .Based 
on all available evidence, grade point average ddes not » 
predict . how well medical students will perform in 



medical .practice. That is, regardless of any possible 
restriction in the range of talcfnt sampled, present 
academic grades do not differentially predict later 
performance. & J| 

x Medical school grades are inadequate as substitute , 
criteria for on-the-job performance o^. physicians. Our 
reseaich has shown that academic performance is in- • 
dependent of actual performance and typically comes 
out as a separate and independent factor. In other 
words, grades do not come close to being parallel forms 
to later criteria of professional performance. In fact, the 
correlations fall far short of being high enough for satis- 
factory reliability coefficients, but instead nearly all 
of them arc so low as to question whether any of them 
were truly non-zero correlations. Thus, such measures 
• arc totally^ inadequate' as cither substitutes or early y 
indicators of later performance. This conclusion would 
Ukcly hold even if extremely generous correction for , 
restriction of range of talent were applied, due to the 
consistently zero or low levels of correlation found 
between grades and actual performance measures. 

Correction for restriction fJT*T?^jgc in our data 
would y ield a greater number of moderately high nega- 
tive correlations than high positive ones, a troublesome 
finding, indeed, for school grades .... 

Correction formulas for direct restriction of range 
(on grades, for cxamplfc) arc not highly corrective for 
near-zero correlations, especially in the case of multi- 
ple independent criteria. (Correction formulas for 
indirect restriction of range are, of course, even less 
corrective,) (pp. 15-17).* \ 

However, this argument still does not give enough 
attention to the fact that medical students arc selected 
on the baais of academic ability and on the basis of a wide 
vaiiety of other personal characteristics That is, the 
academic ability of admitted medical. students i£ so high 
th^t differences in their medical school grades and their 
subsequent performance may not be attributable, to their 
ability. FurthcriuorcVas research reported by Balrd (1975) • 
indicates, medical school students also tend to-be relatively 
homogeneous oy such characteristics as career values, scl^f- 
coitecptions, educational orientation, and family -back- 
ground. And, obviously, as pjeiuedical students they had 
very similar educational expe'r iciices prior to medical 
school. Thus, medical students represent a group "restricted 
in range" in terms both of academic ability and a variety of 
other characteristics. The argument also neglects, sonic of 
the groups own findings that medical school grades did 
have some relationship with overall judgments of physi- 
cians' accomplishments (Price ct al. 1973). That MCAT 
scores and medical school grades were not consistently 
related to narrower and more specific criteria of physician 
performance may havemorc to do with the complexity of 
the physician's role, and the specificity of cacli situation 
rather t**an to the unimportance of academic ability in the 
physicians performance. Obviously, the basis for award of 
medical school grades could be impiovcd to incorporate 
judgments of more characteristics needed in the physician's 



© 14 

ERLC 



2o 



actual work, and selection decisions fcould place more 
weight on evidence of such characteristics in applicants. 
■However, this still would not eliminate the importance of 
|5$ademic ability for successful completion of the medical 
.school program and preparation for the work* of the 
physician. . . , 



SUCCESS IN HIGH- AND MIDDLE-LEVEL 
MANAGEMENT 

A large group oi stuJics has been concerned with the pre- 
diction of success in management. Such volume might be 
expected, since companies and organizations naturally 
have a strong interest in locating variables that will help 
yhem select managers. For their practical purposes, the 
Wudies are most helpful. However, for the purposes of this 
rc^ew, these studies are less valuable. The definitions of 
managerial success vary from study to study, and spine 
ostensibly objective criteria, such as salary, aro'mudi more 
problematical than they first appear. However, as an area 
that employs the largest number of college graduates, 
and one that is obviously realistic, managerial success 
is probably of more importance to more people than any of 
the other criteria examined in this review. The studies fall 
into tour main groups. (J j those using some measure of 
salary as the criterion, (2) those using managerial level 
attained as the criterion, (3) those using ratings as the crite 
non, and (4) those using an overall index or composite 
as the criterion. i 

Studies Using Salary as the Criterion * 

This criterion has many advantages as an index of manage- 
rial success since salary is the ultimate indication of the 
value a company places on an individual. In that sense, 
it may be more indicative than job tilles or managerial 
level. However, salary as a criterion must be viewed with 
caution. Obviously, if salaries at different times are com- 
pared, they should be adjusted for inflation. A high salary 
after five years in a company is more indicative of success 
for a person who began with a low salary than -for one who 
began with a high salary. The first personlias made a great 
deal of progress; the second, relatively little. Salary 
schedules differ from iipdustry to industry 'and company to 
company, so studies <^f salary conducted across companies 
need to be interpreted carefully. The studies reviewed in 
this section have dealt with these problems with varying 
techniques and with varying success. 

For example, Harrell (1969, 1970) attempted to 
control for the type of the company in which Stanford 
MBAs were working. In the. firsl ^tudy, three classes of 
Stanford MBAs who were working in big business firms 
were surveyed to ascertain their current salaries and 4n- 



comes. The highest-earning third (A r =55) was compared 
with the lowest-earning third (N-55) on a variety.of mea- 
sures administered during graduate study, including the- 
Strong Vocational Interest B|ank and the Ghiselli Self- 
Description ItAitory. Second-year business school grades ' 
distinguished the groups, although undergraduate grades 
and Admission Test for. Graduate Study in Business 
(ATGSB) scores did not. A variety of personality nleasures 
suggested the high earners wore 'self-confident, ascendant, 
and had high energy. In the second study, IlarreH (1970) < 
compared the highest- and lowest-earning thirds who were 
working in small business. Again, neither undergraduate ' 
grades nor ' ATGSB scores distinguished the groups, 
although second-year business school grades did, as did an 
ascendance scale. Harrell (1972) repeated these procedures ' 
with the addition of two more classes and a time period up 
to 10 years, with essentially the same results. 

Another strategy was used by Dodd, Wollbwick, and 
McNamara (1970) who controlled for the levej of education 
within one .company by studying persons \vhoiiad the same 
training for their position. TJiey followed ijp 396 IBM 
maintenance technician trainees for 9 years. At the end of 
this period their positions rangedjrom low-grade technician 
(which was similar to their entry position), to high manage- 
ment positions. Salary was used as a surrogate variable for a 
'management success. Training grades and the Gordon * 
Personal Profile "ascendancy M scale botV-correlated .23* 
with salary after 9 years, althouglrthe Otis intelligence scale 
did not. 

Yet another strategy was used by Tenqpyr (1969) who 
found that for 113 managerial personnel a verbal compre- 
hension test was correlated 4 (r=:29) with salary corrected 
for age and seniority. The Leadership Evaluation a/id 
Development Scale was correlated .36 with' the same 
criteria'. 

For 136 alumni of the Carnegie-Mellon graduate 
management program, Weinstein and Srinivasau (1974) 
obtained salary data, adjusted for work experience^They 
related salary tt predictor information. Grades in graduate 
management school were correlated .49 with salaries of 
those in line positions and .24 with salaries of those in staff 
positions. ATGSB scores, undergraduate CPA, and 
"scholastic recognition" did not survive a cross-validated 
multiple regression analysis (these were the only data they 
reported) among either staff or line managers. Ratings of 
involvement in social and sports activities were also posi- 
tively related. ■ " * * 

Wise (1975) obtained data about the fate of salary 
increase among 976 college graduates sampled from a large 
manufacturing corporation. Background data were related 
to rate of salary yicrease. College CPAs were related to the 
rate of salary inueases'in a rpgression (least squares) analy- 
sis alo.ng*with such personal qualities as leadership, as 
indicated by college leadership activities. (Zero-order r's 
showed the CPA was correlated .24; holding an M.A. degree 
.22, leadership .26). Wise concludes: 
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These findings lend support to the practice of selecting 
students on tlie btfsis of academic measures.' But non- 
academic attributes, largely independent of academic 
characteristics, have also been shown to affe'et productiv- 
ity,. The two groups seem to be of approximately equal 
importance. In light of the use of the college degree 
• * as an occupational screening device, this suggests a 
m second look at the practice of selecting persons for 
higher education solely or largely on the basis of 
academic aptitude or achievement. If persons were 
selected for higher education on the basis of their 
potential prqductivin in a chosen occupation, rather 
than their potential as future students, Ironside rat ion 
of nonacademic as well as academic attributes would be 
nccessajy. (pp. 364-365) , * 

Two studies suggest the importance of controlling for 
^ educational attainment. Kinlocli .and Pcrrucci (1969) 
studied a Rational sample of 143 plantations and n/SaFly 
4,00Q engineers and managers. Of these,. 1,142 subjects 
wtili 0 to t> years experience were studied in detail. College 
grades had gamma coefficients of .42 with monthly salary, 
.38 with yearly salary, .18 with level uf supervisory respon- 
sibility, .40 with level of technical responsibility, and .31 
with participation in professional activities. Degree level, 
however, had gamma coefficients of .80, .62, .31, .60, and 
,57 with the same criteria, and prestige of college correlated 
.33, .23, .08, .25, and .23 with the same criteria. Unfor- 
tunately, this study did not attempt to" controj^for the 
effect of obtaining advanced degrees and then examine 
the effect of grades. «- " 

Pcrrucci and Pcnucci (1970) studied a sample of 
engineers who had received their B.S. dpgrces in engineering 
from the University, of California at Berkeley and4hc Uni- 
versity of California at Los Angeles from 1947 to 1961. 
A^jollow-up several years later gathered information about 
(1) their gross annual salary in 19oh (2) their average 
# .monthly salary 4n 1962, (3) the level of their technical 
responsibility, (4) the level of their supervisory rcsponsibili-. 
ty, and (5) their involvement in professional activities. 
Gamma coefficients showed that collcgc gradcs were related 
to each of the criteria as follows. (1) .40, (2) .35, (3) .17, 
(4) .27, and (5) .29. Degree level was even more strongly 
associated, having the following gammas. (1) .75, (2) ,57, 
(3*) .21, (4) .58, and (5) .51. Again, no attempt was made 
to control for the effect of degree level in relating grades 
to the criteria, so that a more sophisticated estimate of the 
relationship- between grades and success was not possible. 

Finally, two studies illustrate the use of multiple salary 
criteria. Crooks and Campbell (1974) obtained data from 
* 128 University of Michigan MB As and 66 Cornell Universi- 
ty MBAs six years after tjicy had graduated from*busincss 
school. A'carccr history questionnaire was administered to 
obtain information about salary and salary progress, mobili- 
ty since MBA, level of responsibility attained, and level in 
the management hierarchy. In addition, an executive 
- position description questionnaire was administered.* 

Predictor variables included undergraduate grades, ATGSB 

f • 
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scores, business school grades, and business school faculty 
ratings on 13 scales plus an oveiall lating of performance. 
The authors- used a variety of measures of current salary, 
increase in salary from«starting salary, and rate of increase. 
Although business school grades were correlated .14 with 
three measures of current salary, undergraduate grade /nd 
ATGSB ^scores were unrelated. None of the academic 
predictors was related to the indices of increase or rate of 
increase in salary. 

In another study, Tfcffcr (1977) found that among 
215 MBAs from "a large, prestigious state university*' 
who responded to tr follow-up, neither -CPA nor, ATGSB 
scores were related to salary (20 graduates a year -from • 
1960 to 197^ were saifiplcd), whether considering Starting, 
current salary, or salary adjusted for inflation. 

To summarize, most of the studies .of salaries among 
ipanagcrial level employees found a low relationship 
between salary and«mcasurcs of academic ability. (The same 
general results were obtained in studies reported earlier by 
Muchinsky and Hdyt 1973, 1 974.) win general, as noted 
earlier, the closer the content of the measure of academic 
aptitude or performance was to the actual duties of the 
% current position, the higher was the relationship. 

( Studies Using Level of Management Attained 
' as the Cr iter ton 

Like salary, the managerial level a person attains must be 
used cautiously as a criterion. Again, titles and levqls differ 
from company to company. The same supposed lpvcl lias 
entirely different meanings in different contexts. For ? 
example, some companies have only two or three vice 
[ .csidents, each of whom has broad powers. Banks have 
traditionally hud many vice presidents, many of whom 
must work within nanow areas. The issue is further compli- 
cated by the fact that the attainment of a high-level 
position represents a different level of accomplishment at 
different stages of the career. A vice presidency at 35 is 
usually a greater accomplishment than one at 55. Again, , 
the studies have controlled for these complexities with 
varying methods and success. » 

For example, Kraut (1969) conducted a study based on 
the notion that a high-level test is needed to discriminate 
among high-level managers, i.e., that the low correlation , 
between academic ability and success in high level accom- 
plishment found in other studies is due to the easiness of 
the tests used, which would result in a* iTarrow range of 
scores. Consequently, Kraut used the Cohccpt Mastery 
Test and the Ship Destination Test, both ve*ry difficult 
tests. They wefc administered to 235 middle managers and 
130 higher level executives who atterded advanced manage- 
* mcnt training programs. "Hie results showed that the num- 
ber of position levels the managers had moved four to seven 
years later was unrelated to cither test in cither group. 
In explaining these results, Kraut argued tlut the number of 
managerial levels moved up is the best or most important 



marker 'of managerial success. He argued for a "thresl)old" 
effect: beyond a mitiinisri level of talent.needed to handle 
the work of management, no more is needed. * 

The Kinloch and Perrucci (1969) and Perrucci and 
Perrucci (1920) studies reviewed in the last section found 
ganmrifrcoefficients of .40 and .17 between college grades 
%nd the level of technical responsibility, and .18 and .27 
between grades and level of .supervisory responsibility. 
However, as noted, in thpse studies there was iro control for 
level of degreis attained.* a 

Using the same- five classes described earlier (Harrell 
1972), Harrell and Harrell (1973) compared the Stanford 
MBAs who had reached general management with those 
who were .marketing, finance, consulting, accounting, 
production, and engineering, including research and de- 
velopment. Second-year grades did not seem to be sclated 
to attainment of early general management positions. On 
the ATGSB, generat manager* had higher quantitative 
scores than those in marketing, but lower scores than those 
- in production. There were no differences on ATGSB verbal 
or totSl score. Again, it is probably hard to distinguish . 
among Stanford MBAs in terms of academic ability. 
General managers tended to be energetic, decisive, 
dominant, and extroverted. ^ 

• Crooks and Campbell (1974). in the study described in 
the last section, used a variety of definitions of supervisory 
level attained and related them to ATGSB scores, under- 
graduate grades, and business ^school grades. ATGSB verbal 
and business grades were correlated .15 and .15 respectively 
with a score reflecting long-range planning, and business 
school grades were correlated .17 with a score reflecting 
exercise of broad power. Some otthe measures were corre- 

. lated \vith whether the person administered an aiuTual 

• budget. Undergraduate grades were correlated -.22 with 
this criterion. ATGSB quantitative, -.20, and ATGSB total, 
-.15. 

In sum, there isArtixed evidence for a low relationship 

• between supervisory level attained and measures of 
academic ability and grades. , 

Studies Usins Ratings ; as Criteria 0 

The 'advantages and di&dvantages (gratings as crit'eria of 
"Success were discufced Jn .the section on scientists^ Al- 
though the advaijtagas art ^similar, some of the disadvan- 
tages rtrc greater in management. The behaviors thaVare 
« being rated are not as clearly related, to success arjfl are 
often difficult to observe or rate: Again, studies hayg^ried 
in the sophistication with which they have used stings. 

For example. Tei\opyr (1069), in the stud^ described in 
the last section/ used only two ratings: supervisor's^ting 
and a labor relations rating. Neither was signpamly 
related to a verbal comprehension test. In a somewhat more 

* complex study, Rowland a*d Scott (1968) used superiors' 
ratings of: (1) supervisors' characteristics, and (2) amount, 
lind (3) quality »of work done by their work groupjTkjpo^ 



sure of intelligence, the Purdue Adaptability Test, was un- 
related to any of tbe criteria. 

Palleft and'Hoyi (19(>8) used a great variety of ratings. 
A. sample of University of Iowa graduates who had graduated 
between 1954 and 1959 were followed up in 1964, or 5 to 
10 ye^rs later. Those' who were employed were rated by 
their immediate supervisors on rating scales which yielded 
23 three-item scale scores of "elements of srecessjn general 
business" In 'addition, overall ratings of "progress" and 
"potential" were obtained. These r were correlated with 
scores on the Iowa'College Scholarship and Placement Tests 
and with gnTdes^the last two years of college. The former 
was available for 1'16, and the latter for 184. The scholastic 
aptitude test scores were related to five of the criteria' 
problem solving ability (r=20),* judgment (20), accuracy 
(.27), dependability, (.21), and writtei) communication 
(.19); college CPA was not related to the criteria. 

In studies reviewed in the section on fatings of scientists 
and engineers, Kaufman (1972) found relation between 
supervisory ratings and measures of academic abili£y,in one 
of the three samples studied. The Muchinsky and Hoyt 
(1973, 1974) studies found similar results. u 1 

f , r 
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Studies Using t Gen^ral pr Combined Criteria 
of Success " # * 

Finally, a few studids have used" general or composite 
criteria of success. These have varied. In a study^of the 
interaction of various traits with inotivation, IGhiselli 
(1968) judged 271 middle managers in a varictyx^f busi- 
nesses and organizations as "unsuccessful" o/> not. A 
measure of intelligence did' not 'correlate with this rat iflg, 
whatever the motivational state. 

The Standard Oil Company of New^crsey (SONJ) 
has assessed managerial success for many years. As reported 
by Laurent (1962), SON J sought predictors of threq 
criteria, relative position level attained, salary prdgrcss, and 
Ratings,, of managerial effectiveness. These criteria were 
combined to form "an overall success index, which was 
shown to be independent of age and e^eriencc- This was 
correlated with a variety of measures. Tli^est correlates, 
in<two samples, duuble cross-validated, qiyconsisting of 
222 managers and the other of 221 manage^, were special 
biographical" sSrvty keys (r=.63 in one sample, :50 in. the 
other),- special Guilford-Zimmerman keys (r= 31 and .3$), 
.and a 'management judgment test (r=.51 and ..47). The 
Miller Analogies Test correlated .18 and .1*7 with success, 
and a nonverbal reasoning test correlated .20 and .08. 
Unfortunately, the specific correlations in the biographical 

• scale are confidential, so there is no hard information about 
the correlation of college 1 grades with success. However, a 

'personal communication from Laurent, as reported by 
Campbell et al. (1970), indicated tliat successful managers 
had been successful in college were active in taking advan- 
tage of leadership opportunities,pdnd were forceful, domi- 
nant, assertive, and confident. 
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A number of other industrial studies, such as those 
conducted -at Prudential Insurance (Selpver 1962), have 
used academic ability measures, and the written reports 
suggest that they may be useftil predictors. Unfortunately 
the reports are frequently vague about specific remits, 
which is 'often cfesuto thcif^ desire for secrecy about tJ»*ir 
companies. However, Bent/ (1967) studied the success of a 
wide variety of executives at Sears, Roebuck, and Co., and 
found that the highest median Jbiserial correlations were, 
in descending order* Allport-Vernon-Lindsey political 
score (.28), Guilford-Martin self-confidence score (.25), 
Kuder persuasive (.21), ACE test total, scor^ (.21), ACE 
linguistic score (21), and Guilford-Marlin masculinity score 
(.21). * 

As Campbell et al. (1970) point out, most of these 
studies have technical weaknesses, such as lack of cross- 
validation^ contaminated criteria, and % inappropriate 
- statistics They' are also ^difficult to* summarize as a group 
because they have used different criteria, different predi., 
tors, and very different metfiods of assessing predictive 
accuracy Finally, some of the investigations have been 
done on firsl level supervisors instead of higher-level 

* management officials. In addition, many of>the studies are 
based on small samples, use poorly validated instruments, 
and demonstrates concurrent rather than.predi^ive validity. 
However, the fact that tests of academic ability were cor 
related with the criteria provided some positive validity foi 
such measures. 

In a related' publication, Dunnette (1971) described, 
studies conducted at the firm of Ame lean Telephone and 
Telegraph that built* on the earlier work Qf Campbell et al. 
Eigfu behavior rating factors were" developed (general 
effectiveness, administrative skills, Interpersonal skills, etc., 
plus an overall staff prediction of the eventual success of 
<he ratees). The company's test of mental ability was later 
correlated, along with the assessment ratings and other 
tests, with salary progrc** of college and uoticollcgc men. 
Generally, tl\e highest and most numerous correlations were 
with staff assessment judgments, group simulations of 
business dealings, and interview ratings. The highest cor- 
relations for the mental ability Jest and two nfcasuics of 
"success" were, for college men in Company A, 48 and .38 

.respectively, in Company C, ,51 and .32, for non-college 
men in Company B, .47 and 45, and in Company C, .52 

*and.28. 

In a later AT&T study, Grant (1975) reported on the 
predictive power of an initial assessment in relation to 
management level reached eight years later. Tor 123 college 
,mcn, the most important predictors were variables reflect 
ing interpersonal skills, personal stability, administrative 
skills, energy, and ^ambition, scholastic ability correlated 
.19. Among noncollege men, the most important predictors 
were interpersonal skills and administrative skills. Scholastic 

^ ability* correlated .31. There was no information about 
f\hc ability level of the first group, except that they were 

* efcHege graduates selected by ,the company. 
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Because of the manner in which these last few studies 
have been reported, it is difficult to assess the adequacy of 
the samples, measures, or criteria. However, the Grant 
report suggests tlTat academic ability has mjiuc influence 
on managerial success. This conclusion applies to all the 
studies in this section. 

Summary 

■\ 

Korman (1968) examined a wide variety of studies pub- 
lished from 1947 to 1965 attempting to predict managerial 
performance. Criteria included ratings of performance, 
administrative level attained, salary, objective performance, 

,and terminalion^of employment. A variety of predators 
\v«?re used, including verbal ability Icsh (Cooperative 
v School and-College -Ability Tests, California Test of Mental 
Maturity^ American Counoifon Education, Miller Analogies 
Test, etc.*). Kojman concluded that such tests had some 
value in predicting the performance of first-line supervisors 

. but were less useful in predicting higher-level managerial 
performance. He argued fliat thiiwasnol because cognitive 
skills were unimportant at such levels but because the 
groups are ,so preselected that it would be hard to show a 
■ relationship. The latci leseardi reviewed here tends to 

-corroborate that conclusion. The research also suggests 
that the measure of academic success most relevant to 
managerial work-business .school* grades-does have a 
positive relation with managerial success* Again, the closer 

. the cunrcnt of *tlu measure of academic ability was to 
the actual duties of a field, the better it predicted. 



ACCOMPLISHMENT IN HIGH SCHOOL 
AND COLLEGE 

To this point wc have examined the relationship bcUeen 
academic ability, oi academic success and adult accom- 
plishment, the criteria of accomplishment have varied, 
but all have had loanable face validity. It could be argued 
that all represented some accomplishment or performance 
that is valuable in the real world of adult life. In this 
chapter wc shall examine a large body of research con- 
cerned with accomplishment in the high school or college 
years. This level "of accomplishment can vary considerably 
* in its intrinsic importance" and its* relevance to accomplish- 
ment in the adult "world. Tor example, an undergraduate 
who publishes an article in a scientific or scholarly journal 
has met the same high-level standards faced by professional 
scientists or scholars. In contrast, a student who works on 
the school newspaper may only be fulfilling a requirement 
in a journalism class. The .aiteha used m most of the 
studies reviewed in (his chapter were designed to cover a 
range of accomplishments from the piivate and fairly 
common (e.g., writing a poem for onc\s own pleasure) 
to the public and rare (e.g„ winning a prize for a scientific 



experiment). Thebe catena arc generally fairly similar tu 
adult accomplishments, but are set at a somewhat lower 
level and within the school or college context. The be- 
haviors have clear significance within those -contexts, 
although their importance ior the general society is not 
always entirely clear. However, they do represent accom- 
plishments withiirTTparticufSr setting,*and tljey atf impor- 
tant as precursors* of later attainments. Furthermore, a 
number of the studies of adult accomplishment that have 
been reviewed in earlier chapters have found that most 
people who achieve at a high level during their adult careers 
had also achieved ih'thc same areas during high school 01 
college. * 

Since the meaning of attainment is especially important 
in these studies, considerable attention will be devoted . 
to descriptions of the development of criteria in the follow 
ing "ages. The studies fall into two categories: those 'hat 
wc.c conducted at the Nafcnal Merit Scholarsliip Corpora 
tion and the American College Testing Program, and all 
others. 

The National Merit Scholarship Corporation and 
the American College Testing Program Studies 

The National Merit Scholarship Corporation (NMSC) was 
founded in 1955 with the purpose of identifying the 
nation's mo$jt talented high school students and providing 
financial assistance for then: college educations. Su ported' 
by funds from the Ford Foundation and the National 
Science Foundation, the NMSC tested several million 
high school students each year. After a number of studies 
of the predictors of the academic accomplishment of the 
very bright students who received scholarships, the hfMSC 
research staff began to explore definitions of talent broader 
than that of academic ability. Since* they were concerned 
about identifying students who would potentially make a 
creative contribution tQ society, as well as lo identify 
those who were bright, the NMSC research staff began a 
series of investigations into the nature of creative accom- 
plishments. Subsequently, the American College Testing 
Program (*ApT) conducted a series of similar studies. These 
studies can be divided into the'correlajional studies, the dis- 
tribution studies, and the technical studies. The correla- 
tional studies will be roviewxd first. 

• In the first of the NMSC investigations, Holland (1961) 
reviewed the secondary school achievements of Merit 
^Finalists and developed scalps of "creative science per- 
formance" and "creative arts performance." Because all 
the scales used in subsequent studies follow the basic 
model Holland used in this study, his account of the scales 

deserves to I}e quoted in full. % * 

1 

The criteria of creative performance were derived from 
a checklist of accomplishments assumed to require 
creative or original behavior. Creative performance is 
J defined as a performance which is v accorded public 



recognition through awards, prucs, or publication, 
and which may therefore be assumed to have exeep 
tional cultural ,valuc. Because of the difficulty in 
arriving at a generally acceptable definition of 'creativi 
ty,' these criteria should perhaps be regardcd*as either 
'notable scientific or* artistic performance,' although 
we will refer to the criterion as 'creative' performance 
hereafter to enhance readability. With this definition 
as a guide, a list of 20 achievements at the high school 
level was derived by reviewing the secondary school 
achievements of Finalists from previous years. Items 
were divided by content \nto two scales. Creative 
Science (5 items) and Creative Arts (I I items). (Four oi 
the original 20 items were omitted because they ap« 
i peared to be Inadequate signs of creative behavior.) 
(p. 137) 

Holland that the creative pciformniicc scales 

were basically unrelated to grade:* and academic ability. 
Furthermore he found that the scales and grades were cor- 
related with very different incisures. Many of the variables 
winch had the highest correlations with the creative per- 
formance scales had negative or near-zero correlations with 
grades. However, this conclusion is based on results from 
an e.vtreiuely nairow band of academic talent. T^ie Merit 
Scholars were highly selected, not only in terms of 
* academic talent approximately the top I percent of aoplj- 
% cants -but also in terms of their extracurricular activitjep, 
their reputation among school and local officials, etc. 

Holland and Astin (1962) also found essentially no rela- 
tion between college-level ".creative" accomplishment and 
grades and academic ability in four separate samples of 
Merit Finalists in each year of college. In addition to Mie 
'scales used in the Holland (1961) study, they developed a 
scale of social or leadership accomplishments. Holland and 
Astin studied the predjetive* validity of information 
collected before college over one, two, three, and four 
years. Again,' no' relation between grades or ability and 
creative and social accomplishment was found. They also 
found that grades and social and creative accomplish- 
ments had different patterns of, correlations with the 
predictive variables, which included the 16 PF and 
California Psychological Inventory. 

Nichols and Holland (1963) examined 154 predictors of 
the first-year college achievements of a sample of Merit 
Finalists in academic areas and in the areas of science, art, 
writing, dramatics, music, and leadership. Items similar 
to the ones used in this and subsequent studies arc shown 
in Table 2. To study the possibility that different predictors 
could be related to all accomplishments and to rare accom- 
plishments which involve public recognition, analyses were " 
conducted both ways. Essentially no relationship between 
grades and accomplishments was found for the male 
sample. However, among females, there was a correlation 
of ,30 with all science accomplishments, .32 with rare 
science accomplishments, and .36 with rats writing 
accomplishments. 
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Table 2. Examples of Items Used in High School and College Achievement Scales 



Area 



t Leadership 



Art 



Science 



Music 



Writing 



Speech and Drama 



lh$h~$chool items 



College items 



Organized a school political 

group or campaign 
Received an'award or special 

recognition for leadership 

of any kind 
Was elected to one or more 

student offices 



Exhibited a work of art at my 
school (painting, sculpture, 

Had photographs, drawings or 
other art work published in 
a public newspaper or magazine 

Won a prize or award in a state- 
wide or regional artistic 
competition (sculpture, 
painting, ceramics, etc.) 

Participated in a National 

Science Foundation summc; 

Program for high school 

students 
Won a prize or award of 

any kind for scientific 

work or study 
Gave an original paper at a 

scientific meeting 

sponsored by a professional 

society 

Compotcd music which has 

been given at least one 

public performance 
Performed with a professional 

orchestra ^ 
Received a rating of "good" 

or "excellent" in a state 

music contest 

Mad poems, stories, essays, 
. or articles published in a 
school publication 
Had poems, stories, or articles 
published in a A public news- 
paper or magazine (not 
school paper) or in a state 
or national high school anthology 

Had leads in high school- or 
church-sponsored plays 

Had minor roles in plays 
(not high school- or church- 
sponsored) 

Placed first, second, or third 
in a regional or state speech 
or debate contest ■< 



Active member oT four or more 

student groups* 
Served on a student-faculty 

committee or 

group * ' 
Elected as one of the officers 
of a class (freshman, sophomoie, 
etc.) in any year of school 

Exhibited or published at my college one 
or more works of art, such as drawings, 
paintings, sculpture, etc. 

Had drawings, photographs, or 
other art work published in a 
public newspaper or magazine 

Sold one or more works of art, 
such as drawings, paintings, 
sculptures, ceramics, etc. 



Took part in the Undergraduate 

Research Participation 

program (URP) of the 

National Science Foundation 
Received a prize or award for 

a scientific paper or 

project 
Gave an original paper at a 

convention or meeting 

sponsored by a scientific 

society or association 

Composed or arranged music 
which wa* publicly 
performed 

Have been paid for performing as a profes- 
sional music teacher on a continuing basis 

Attained a first division rating ' 
in a state or regional solo 
music contest 

Had poems, stories, essays, or 

articles published in a 

college publication 
Had poems, stories, essays, or 

articles published in a 

public (not college) 

newspaper, anthology, 

etc. 

Had one or more leads in plays produced 

by my college or university 
Had one or more leads or 

minor roles in plays not 

produced by my university 
Placed second, third, or fourth 

in a contest in speech, debate, 

extemporaneous speaking, etc. 
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A subsequent study by Holland and Nichols (1964) was 
distinguished by the ao&y validation of its result* and b> 
the ' potential" scales which the researchers developed, 
based on the results just described, to assess lowet-level 
activities which might* predict accomplishment. These 
scales were described as follows. 

To predict student achievement in artistic, li^ical, 
literary, scientific, dramatic, and social fields, six 
'potential for achievement' scales tffcre constructed 
for each sex.rStudents falling in the upper and lower 
27 i ; on checklists of accomplishments for these fields 
in high school were co/ft pared for their preferences 
lor 273 daily activities, hobbies, reading habits, school 
subjects, sports, etc. Typical items included working on 
guns, building scientific equipment, playing chefs, 
going to a public library, giving talks, collecting rocks, 
playing charades, and "drawing cartoons. The 15 most 
discriminating items were selected for each of the- six 
Potential Achievement Scales for each sex. (pp. 55-56) 

These Scales were developed to meet the problem that 
many achievements are^uite rare, the rare achievement* 
however, was probably preceded by a variety of lower-level 
activities by which the students' "talents and skills wtyc 
developed, 

Other predictors which had pro\en to be useful in 
earlier studies were also included. In all, they used 130 
predictors. In the results, high School grades and the SAT 
did not appear among the predictors selected by a stepwise 
multiple regression program as predictors of college accom- 
plishment. One interesting feature of this stutiy was that 
there seemed to be little point in distinguishing between 
all achievements and rare achievements. 
%\ 

The most notable finding ... is that achievement in 
high school or daily activities, interests, and involve- 
ments which are related to^ achievement (Potential 
scales) are the best predictors of achievement in college. 
Expressed goals, such as grades a student expects to 
receive in college or making a, contribution to scientif- 
ic knowledge,' are next in predictive efficiency. These 
two trends are followed by a variety of measures of 
lesser usefulness the Indecision Scale, intellectual 
resources in the home, number of competencies, etc. 
Of special interest, the Scholastic Aptitude Test (Verbal 
and Mathematical scales) failed to enter the multiple 
correlations at this high level of aptitude, (p. 64) 

Nichols (19ob) subsequently followed a similar 
strategy. He developed new stales from items taken from 
the Adjective Check List, the Vocational Preference Inven- 
tory, the California Psychological Inventory, and an objec- 
tive behavior inventory, consisting of a listing of 326 
hobbies, sports, leisure time activities, interactions with 
other people, etc. 

A critical study by Holland and Richards (1965) is im- 
portant, not only, because n shifts the research activity 
to the American College Testing Program, but because it 
is based on a large, diverse, and typical sample of college 



freshmen. The sample of 3,770 men and 3,492 women 
mdude/J students from a wide variety of ability levels and 
appeared to be a reasonably representative sample of the 
national college freshman population. The colleges included 
a wide variety of institutions. A new tyj)e of measure was 
used, which assessed students competencies in a wide 
variety of areas. Students checked from a list of 143 
those activities which "you can do well or competently ." 
The assumption underlying these scales is that a large 
number of competencies is conducive to achievement 
generally and that competencies in a particular field are 
conducive to. achievement in the same field. Typical items 
for this list included. "I have a working knowledge of 
Roberts' Rules of Orders "I c^an make jewelry " "I can 
read blueprints." The number of activities checked equals 
a student's range, or total number, of competencies. 
Reasonably reliable scales were also developed in eight 
areas of competency, such as scientific, leadership, art, 
etc. The reliabilities (K-R 20) of the achievement scales 
were considerably higher than those used in the NMSC 
studies, ranging from .72 to .84 for men and .65 to .81 for 
women. 

In general, the correlations between academic measures 
and tjie achievement scales were significant but low, 
averaging .04. The highest correlation between ACT test 
scores and achievement was .18. The highest between 
grades and achievement was .21. In contrast, the competen 
c\ scales correlated with many of the achievement scales'at 
a moderate level. 

The researchers also examined the possibility that the 
basic relation between academic ability or performance and 
the socially relevant accomplishments examined in these 
studies is curvilineai. That is, the correlations are low 
because only the very able are truly able to achieve; i.e., 
the distribution would be so skewed to the high-ability 
end that the correlation would appear low. Holland and 
Richards compared eta coefficients with the Pearson 
product-moment correlations, examined the 'scatter plots, 
and found no evidence for the idea. 

Finally, they computed biserial correlations between 
the items in the achievement scales and the four ACT scores 
and average high school grade. "This analysis was important 
to perform for several reasons: ;ince the scales; of noh 
academic accomplishment ^contain many low level -accom-, 
plishments, the/ may assess quantity rather than quality pf 
accomplishment." TJhe median correlations between ACT 
, scores and achievement was .03 for men, and .05 for 
women, the range .was from -.15 to .22 for both sexes. 
The median correlation between grades and 'achievements 
was .03 for men and .05 for women, the range was frqni 
-.13 to .36 for men and -.11 to .32 for women. Some 90 
percent of the correlations fell between ±.15. 

In 1966, Richards, Holland, and Lutz attempted to 
develop revised scales of college level accomplishments in 
the six areas assessed in the earlier studies, and to develop 
new, scales in the areas of social science achievement, 
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Table 3. SummaiyQ? &icta-Analysis of the Relationship between CPA, Academic Ability, 
and Nonacademie accomplishment 



A. With CPA 



Median 
Correlation 



nigh 

Value 



Low 
Value 



Modal Categories 



Leadership 


.15 


.27 


-.04 


Musk- 


.00 


.16 


-.06 


Drama and speech 


.04 


.12 


-.06 


Art 


-.03 


.13 


-.10 


Writing 


.08 


.'17 


-.05 


Science 


.07 


.19 


-.08 


^Academic Ability 


.oX 






Leadership 
Music 


.06 


.20 
.13 


Drama and speech 


.04 


.18 


* -.05 


Art 


.03 


.zl 


-.06 


Writing 


.14 


.22 


' .04 


Science 


.09 


.20 


.00 



.Hand 
-.05 and 
.01 and 
.00 and 
.01 and 
.01 and 



NoJ 
Correlations 



.25 
.04 
.10 
-.10 
.15 
.10 



59% between 
79% between • 
75% between 
83% between 
82% between 
70% between 



59% between .01 and .10 
71% between .01 and .10 
62% between .01 and .10 
62% between .O^and .10 
71% between .lTand .20 
68% between .01 and .15 



59 
58 
*7 
60 
60 
57 



34 

34 

34 

34 

34* 

34 
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humanistic-cultural achievement, business achievement, 
social participation, social service achievement, and rcli 
gious service. They also developed a Scdle or recognition^ 
foi academic accomplishment. The scales >*q£ administered 
ix> freshmen in 6 colleges, sophomcresVm 31 colleges, and 
seniors in 12 colleges.^ Expcdedly , means on the 10-item 
scales increased from class to class. The median reliability 
coefficient among men was .b5 for freshmen, .66 for 
sophomores, and .71 for seniors. The corresponding figures 
atnongVomcn were .62, .59\ apd .70. 

The researchers found that there were low relationships 
between college grades and the aeeqmplishments^sscs&(d in 
both the six areas studied in earlier studies and the new 
areas in all three sainplcs. In contrast, grades were cor- v 
related with the five-item scale, recognition for academic 
accomplishment, the correlations ranged from .30 to .46. 
"This result is important because it suggests that neither the 
brevity nor the skewness of the* other accomplishment 
scales produced the lack of relationship with grades. 

In a subsequent study, Richarfls, Holland, and Lutz 
(1907) again studied the freshman and sophomore samples, 
this time examining the predictors of college level accom- 
plishments among information collected from' the students 
whcii they were applying to college. Neither high school 
grades nor ACT test scores had correlations as high as .20 
with any college accomplishment in any nonacademie area 
in either sample. * $ 

To examine the possibility , that this lack of correlation 
was due to a procedure which had grouped together 
students trom many different colleges, the researchers also 
computed the correlations of ACT test scores and high, 
school grades with college Achievements of males at each 
individual college in the sophomore sample. The median 
correlations were very^ similar to the correlations for tlic 4 
total sample. The typical correlation was close to zero, 
although tne correlations 'between ACT tests and non- 



academic college accomplishments ranged from -.53 to 
.41 »md the correlations between high school grades and 
nonacldemic college accomplishments ranged from -.49 to ■ 
.31. There was no systematic relationship between the size 
of the* correlations and characteristics uf the colleges. For 
CAuitiple, there Wds no trend for the correlations to be p<jfi- 
\ive in selective colleges and negative in unselcctive colleges, 
A meta-analysis '(following procedures suggested by 
Glass, 1978) of the results of the NMSC and the American 
College Testing Program "results that were based on 
"typical' samples of college students was performed. It 
examined between 34 and 60 correlations of academic 
ability tests and grades with th» accomplishment scales that 
were reported in these studies. As shown in Table 3, the 
results showe\jnedian correlations between leadership and 
grades of .15, and leadership andjtcst scores of .08; between, 
science and grades of .07, and between! science and test 
scores .09; be£veen writing and grades .08, and between 
writing and test scores .14; between dramatic arts and 
grades .04, a arjd between dramatic arts anil tejj scores .04; 
between- musi? and grades .00, and between music and 
test scores .06; and betwee^ art and grades -.03; and 
between art and test scores .03. Thus, in general, there are 
low positive relationships between l academic > ability, grades, t 
and extracurricular accomplishment in leadership, science, 
and writing, but not in the other areas. Why would this be 
so? Students engage in activities for a variety of reasons, s 
related to their needs, their personalities, and their inter- 
ests. The degree of their participation can be influenced by " 
major fields, classes, professors, friends, and residences, to 
name only some obvious influences, These personal charac- 
teristics and situational variables work independently of 
academic ability and may wcjl be more influential. (In fact, 
soniCj NMSC and ACT studies suggest that both personal 
and institutional characteristics do have consistent in- 
fluences on accomplishment.) For examine, students 
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ubpiriu^ to be television wnters tfiay write stories or play b 
no matter what their academic ability. Or a student with a 
strong need for sell -expression may audition for and obtain 
parts m plays. A student who has worked in chemistry from 
an early age ^nay conduct an experiment. A music major 
may have to compose and perforin a composition as part of 
a class requirement. A student in a speech class may be en- 
couraged to enter a debate contest for extra credit. A,pro- 
tessor may encourage a student to submit a poem for 
publication, and another professor may encourage a student 
to cooperate in the writing.. of a*paper. A student's friends 
may encourage her to run for class office. A residence may 
emphasise parturition, in campus clubs or political 
activity. None ot these personal or situational spurs to 
participation and accomplishment neces"sajrily ha& anything 
to do with academic ability. 

Thus, it is not that academic ability is irrelevant in 
accomplishment, but rather that it js one among many 
factors influencing .college attainment. One of the most 
important oi these is simple paiticipation students who 
J tto-\not enter contests cannot win them a variable probably 
'most influenced by interests and needs. Perhaps the next 
most important is the degree of participation- students who 
have roles in many playj> are more likely eventually to play 
a lead Jthan students w^o have roles in only one or two. 
The degree ot participation u> probably most influenced by 
persistence, enjoyment of the activities, and encouragement 
received. 

To summarize, the correlational studies of grades and 
academic- ability tests in relation to scales of accomplish- 
ment show- a small relationship. The small relationship does 
not seem due to unreliability, skevvness, dr other statistical 
detects ot thCN^eales. The samples of students and adults 
represented a wifoe range of 'ability in a variety of ty^sof 
schools, colleges] and sit'Mions and included individuals 
ranging trom high school students to college alumni. The 
.patterns ot* correlations of accomplishments and academic 
potential with personality, interest, value, self-concept, 
and activity variables also suggest that there is a small 
relationship. 

Although the results are very consistent, some individ- 
uals may still question them on the grounds that the corre- 
lations obscure distinct differences between the highly 
academically able and die average person. They argue that 
one' needs to examine tW^distributions of accomplishment 
at different levels of acaderfnc ability. 

There have been several studies of the frequency of 
accomplishment at several levels of academic ability or 
grades. They have been of two types, comparison of groups 
and simulated selection studies. 1 tic first of these 4 studies 
was conducted by Astin (1964), who compared 334 Merit 
Scholar* with an unseleeted sample of entering college 
treshnien at 248 colleges who were matched with the 
scholars on socioeconomic background. The comparisons 
ot high school accomplishments revealed considerable 
superiority of the Merit Scholars in science and writing, 
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slight superiority in leadership, and approximate equality 
in drama, art, and music. These results appear to be in dis- 
agreement wjth the correlational results. However, it should 
be recalled that half of the Merit Scholars were selected by: 
a ciMnp^ttee which no* only examined their test scores 
but also stifaied their high school accomplishments. In 
addition, a number of Scholarships were awarded because 
the students showed promise of exceptional achievement 
. in a particular area or because they were fudged creative. 
In addition, a large number of the remainder were awarded 
according to criteria stipulated by a sponsor, which some 
times included exceptional accomplishment. 

Perhaps a less biase(^comparison was made by Baird 
(1068), who compared* the college accomplishments of 
a typical cross section of students (described earlier under 
Baird 1969a), with the accomplishments, of the very bright 
National Merit Finalists described by Nichols and Holland 
(1963). Both groups reported their accomplishments at the 
end of their freshman year. Comparisons were based on the 
percentages reporting 35 specific accomplishments. Baird 
found that, in general, there was very little difference 
between the two groups. 

In a second substudy, Baird compared the number of 
high school achievements of bright and average students, 
using data from the Michigan Scholarship Program, which 
regularly "fosU a large ' number of Michigan high school 
students and uses the ACT test battery as a basis for con- 
sidering students for scholarships. Only students with an 
ACT composite score of,X or above were considered 
eligible for scholarships. Baird compared students who 
were eligible with those who were not. The mean ACT 
composite score of 14,424 eligible studeaft was 25.5, 
approximately the 86th percentile of students enrolled 
at ACT-partieipating colleges (American College Testing 
Program, 1973). The mean of 10,680 students who were 
not considered eligible was 18.2, approximately the 35th 
percentile on national norms. Baird compared the number 
of high school achievements for "the two groups using 
simple analysis of variance. The researcher also calculated 
Hays's (1963) omega squared (to*), a statistic (similar to 
the intradass correlation coefficient) which assesses the 
strength of an association between variablesjby estimating 
the proportion of variance in a dependent variable ac- 
- counted for by the independent variable. The distributions 
of the number of accomplishments were very similar in 
both groups, although there were small significant dif- 
ferences favoring the high ability group in writing, leader- 
ship, and science. Although these differences were signifi- 
cant, he omega-squared values indicated that in no case 
did academic ability account for as much as 1 percent "of 
the variance in accomplishment. ' 

Llton and Shevel (1969) followed y et another strategy 
to study the rebionship between academic ability and 
nonaLademk>accomplishmcnt, comparing the high school 
accomplishments of* students who were one-standard 
deviation above the mean on both the ACT English and the 



mathematical ■w.otcs. with the accomplishments of those 
who weie below average on both and of those who \v ere 
average -on both. The high-high group composed about 3 
1 percent of the sample, as did the low -low group, and the 
average group about oO percent. The sample was a ,3 
pciccnt random sample of students who completed the 
ACT examination in 196o-19o7. When the comparisons 
ot the individual accomplishment* of the men and women 
in the high-high group with t*te low -low group for men and 
women are combined, the results showed differences favor- 
ing the' high-high group on 20 accomplishments, inferences 
favuring the low group on 14, and no difference* on 02. 
When the high high group was compared with the average 
average gr^oup, the, comparisons favored the high group on 
34, the average group on 9, and showed no difference on 53. 
When the average-average group was compared with the 
low low group, the comparisons favored the average group 
on 8, the low group on 8, and showed no difference on 
^ 80. Thus, there seemed to be some evidence for a relation 
ship between academic ability and accomplishment. 

Subsequently, Werts (1967) calculated the proportion 
of students at several grade levels who had demonstrated 
.accomplishment in 18 different areas of attainment. Werts's 
sample was 127,125 students who had completed a survey 
I of their plans and high School activities when they began 

their first year of college. Students with high high school 
grades tended to have somewhat more accomplishments 
than the students with low high School grades. For exam 
pie, among males, 14.4 percent of the C students versus 
31.8 percent 6f the A students had had a lead in a School 
v play. 

Holland and Richards (1967a) replied to Werts by 
reanaly ling Werts s data to show "what y ou miss by various 

selection ruies as well as what you get By reanalyzing 

Werts* data ... we created a single table that shows what 
percentages of students with various kinds of achievement 
are eliminated by the use of various giade levels as selection 
scores." (pp. 2d5-206). They found that 

The selection of only A+ or A students (a selection 
rule that will admit nearly all students in the top 
decile ot grades) will result in the elimination of 74-93% 
ot all students with various kinds of nonaeademie 
accomplishments. To take another more concrete 
example, if you only select the A or A+ students (about 
the top decile of academic talent), you wpuld get 1,843 
class presidents, but you would mfss 11,096 class 
presidents .... In short, the use of grades as an effi- 
cient sign for the selection of multitalented persons 
is not warranted by the Werts' data. (p. 2Q6) 

Holland and Richards then went on to reply to Werts 
and other critics by presenting evidence to make four 
points which oppose contentions by. their critics. (1) the 
small percentages of students with nonaeademie aceom- 
. phshments do not present a misleading picture of the 
actual relationships between academic and nonaeademie 
accomplishments, (2) the lack of relationship is not due to 
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a narrow range of latent, (3) the lack of relation is not due 
t'» statistical artifacts, and (4) one cannot use academic 
eUcria for selection and hope to select d giuup of students 
v.hu will achieve in nonaeademie creative areas. On the last 
point, Holland and Richards open the question of the com- 
parative consequences of using academic ability and non- 
acadcfrHc^aJcomplishmcnt for selection purposes. Earlier, 
Nicliolsand Holland (1964) had studied these consequences 
in a sample of National Merit Finalists. Information on 
earhei performance had been collected, and the criteria 
were academic and nonacadenlic achievement in college. 
They examined nine alternative methods for selecting 
students, including selecting on ability tests, on grades, 
and on accomplishments. Their conclusions included. 

(a) Additional selection on aptitude using cither the 
same or a different t^st does not appreciably improve 
selection for high-level college performance, (b) Selec- 
tion on the basis df high school rank produces students 
v. ho demonstrate superior academic performance, but 
not necessarily other kinds of achievement, (c) Selec- 
tion on the basis of a broad range of high school 
achievements results in a broad range of achievement in 
college without lowering the level of academic per- % 
formance. (p. 33) 

Subsequently, Wing and WallaJi (1971), at Duke Uni- 
versity, used some of ,the Holland and Richards (1965) 
scale* to examine the types of classes one would obtain if 
one selected on the basis of SAT scores alone, oi>the basis 
of high School rank alone, on the basfs of both SAT scores 
and high school rank, and on the basis of creative accom- 
plishments. Criteria were the students* high school accom- 
plishments and personal characteristics. Lxpectedly, the 
SAT strategy selected students with higher high school 
rank, the high school rank strategy selected students with 
high SAT scores, and the use of both selected students high 
on both. None of these strategies was particularly successful 
in obtaining a class with many, high school accomplish- 
ments. Using high school creative accomplishments as the 
admissions criterion,, Wirjg and Wallach found that a class 
high in such accomplishments would be slightly higher than 
the totaKpopOlation on SAT scores and high school rank. 
Although Wing and Wallach provided extensive comparisons 
of the characteristics of students about whom the admis- 
sions decisions of the strategies disagreed, they did not 
show the characteristics of the students who would be re- 
jected by each strategy by itself. 

The Wing and Wallach study was criticized in various^ 
quarters for the restriction of range of academic talent 
(average SAT-verbal and mathematical scores of the appli- 
cants were close to 600, the accepted students close to 
650), for the fact it was confined to a single institution, 
" and for the lack of follow-up data, that is, the performance 
of the admitted students in college. 

Earlier than the Wing and Wallach study at Duke, Baird 
and Richards (1968) examined -the effects of various selec- 
tion strategies in a large sample of students in 35 diverse 



colleges. In contrast to the Wing ami Wallach study, „ 
analyses showed their sample to include a wide range of 
academic ability and to be representative of students at 
these colleges. Furthermore, the success of the selection 
strategics was evaluated by college criteria of the number of 
college accomplishments in six areas, college grades below 
C, college grades of A\ and the percentage who had dropped 
out. The st- regies were, (* admission only on the basis 
ol grades, (2) admission on tne basis of high school creative f 
accomplishments, and (3) admissions on both. First, the 
characteristics of entering classes which would be admitted 
by the stratcgits were examined, These analyses showed 
that the use ot grades to select students would result in a 
class of students who would make pacing grades (but few 
who would make A grades in college), who would not drop 
out, and who would not be more (or less) likely to achieve 
in nonacademic areas. Admission on creative accomplish 
menu would* result in college classes that would include 
many student* who would write stories and essays develop 
their own science, experiments, create their own music, 
take part in college and non-college plays, submit Works of 
art to art congests, and run for campus offices. The students 
selected by this strategy would be also somewhat less likely 
to drop out but were not more (or less) likely to have good 
grades. When the selection strategies were compared on the 
basis of the number of college achievers who would be 
eliminated by the strategy, Baird and Richards found the 
following results, stringent selection on (lie basis of high 
school grades would result in the elimination of most stu- 
dents who would have college accomplishments in leader- 
ship, art, music, speech and drama,, writing, and science. 
In addition, the selection of students with high school 
grades of B+ or above would also result in the elimination 
ot three quarters of the students who would obtain passing 
grades in college. The results for the strategy of using high 
school creative accomplishments for selection arc compli- 
cated because the consequences vary from area to area. 
However, it is" clear thaf stringent selection on nonacademic 
accomplishments also eliminates many nonacademic as well 
as academic achievers in college. 

r i 

Other Studies of Students 

We have concentrated on the NMSC and the ACT studies 
to this point because they form a continuous body of in- 
quiry. However, there are several other studies involving 
students that have examined the relationship between 
academic ability and accomplishment and that used dther 
measures and often concentrated on other questions. 
* For example, Milgram and Milgram (1976) used a crea- 
tivity test and a variant of the accomplishment criteria 
just described. They studied an entire high school class (60 
boys and 85 girls) in Tel-Aviv. The criteria were self-reports 
of accomplishments adapted from Holland and Richards in 
nine areas ranging from science to sports. All were lumped 
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together in three different scoring systems. High scorers 
scored high on an adapted version otjthe Wallach and 
Kogan (1965) creativity battery, but not on IQ or school 
grades. They also found that quantity and quality of 
accomplishment could not be separated. 

^ ? Similarly, Cropfey (1972) administered six* creativity 
tests plus an IQ test to seventh graders; five years later, • 
111 of these students were questioned concerning their 
art, drama, literature, and music attainments, using the 
Holland and Richards scales. No significant correlations 
were found between IQ and the criteria anlong girls, and 
only one (.32 with literature) among boys. Cropley f'^und 
some low positive correlations between attainments a^d 
creativity tests. 

Skagcr, Shultz, and Klein (1965) developed an instru- 
ment similar to the Holland and Richards scales, the Inde- 
pendent Activities Questionnaire. They developed scores on 
the number of school accomplishments (quantity) 
and then judged the quality of the accomplishments for 
142 male state university entering freshmen and 150 male 
technological institute freshmen. In neither sample was the 
SAT-verbal score, SAT-mathematical score, or high schocri 
rank related to quality or quantity. However, when the 
samples were combined, there were small correlations 
between quality scores and the SAT, chiefly because the 
technological institute students had higher SAT and quality, 
scores. 

In a study by Locke (1963), 122 high school juniors 
and seniors attending a Cornell University summer NSF 
program were given a large battery of tests which were 
factor-analyzed to yield 11 factor scores. Criteria were 
classroom achievement, as represented by grades and 
teacher ratings, and out-of-class achievement, as represented 
by ratings of the^ainount and quality pf independent 
scientific work dona and teachers' comments about the 
students. Classroom achievement was predicted by mea- 
sures of vocabulary, self-control, and high socioeconomic 
status versus independence. Out-of-class achievement was 
predicted by school and city size, creative energy, inde- 
pendence, and originality. Vocabulary and general reason- 
ing measures were unrelated to out-of-class achievement in 
the total sample. 

Using somewhat different criteria, James ct al. (1972) 
obtained faculty ratings of 813 high school students for the 
areas of dance, music, theater, and visual art. They also 
u^ed checklists of creative activity and recorded the number 
of awards in arts obtained by eacji student. Although no 
detailed results are reported, they concluded "The cor- 
relations between the art criteria and academic CPA varied 
from nonsignificant to moderate and significant. In general, 
it appeared that somewhat different subsets" of abilities 
were requiredibr successful perfonmncc in the two fields." 

The five studies just reviewed were general research 
studies, concerned chiefly with studying the relationships 
among variables. The next three were related to the practi- 
cal concerns of scholarship programs. 
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Dattd (1%7) studied high school senior applicant* tu 
the WcsOnghousc Science Talent Search (STS) who had 
submitted a research project that was judged fur "crea- 
tivity and potential creativity," b> the refined method* of 
tlu *cdich. Only students who Scored above the 80th per- 
centile on a scientific aptitude test were deluded. Five 
hundred thirty -six of these students were divided into 
three^ groups, differing on the rated creativity of their 
project. There were no significant differences between the 
gioups on the SATverbaf or SAT mathematical scores.. 
It should be nokd, however, that the mean SAT scores 
were quite high. 

In a later study, Parloff et al. (1968) compared 206 
participant's in the S^TS whose reports of an independent 
leseardi project were judged creative with 672 whose 
projects were judged less so, (All scored at the 80th per- 
centile o*i Inghei on a science aptitude test.) There were no 
-.diffcrcnu * on SAT-verbal or -mathematical Scores, high 
school giade average, social class, or birth order. There 
were, however, differences on some personality scales. 

Edgerton (n.d.) examined data from the 1968-69 STS 
fui the Wcstmghousc Scholarships and Awards piograin. 
Students around the country submitted an independent^ 
research project, a report of more than 1,000 words,, a f . 
peisonal data blank, and a high school transcript. They also 
completed a scienee aptitude examination. From the 2,356 • 
seniors found eligible, an honors group of 300 was selected, 
and 40 scholarship, winners were chosen from the latter 
group. Four selection models were compared; (1) a model 
placing primary emphasis on quality of research project ("a 
basis of actual performance analagous to that of adult 
scientists"), (2) a model using the successive hurdles of 
academic achievement in high school, scores on the science 
aptitude examination, and then the project, (3) a model 
using examination scores and academic achievement only, 
(4) a model .using a composite of attainment in all areas. 
Results were "that two-thirds of the students chosen 
for their Scientific Performance would , not have high 
enough scores if Academic Achievement had been the sole 
criterion. And two-thirds of # those chosen on a basis of 
Academic Achievement had such low ratings on then 
Project Reports and Personal Data Blanks that they were 
not included in the Scientific Performance. . , . Since the 
overlap among the studen^chosen by these two means was 
relatively small, it strongly suggests that evidence of scien- 
tific talent as indicated by actual scientific performance is 
only partially related to academic achievement. " 

Similar result* were obtained by Schmidt (1973) who 
used six measures to predict the standing on seven criterion 
measures of creativity among 105 lirst-year architecture 
student*. A measure of academic success w ^ not related to 
the criteria. * 

Gctzel and Czihszentmihaly l (1975) administered a six- 
hour battery of tests to 179 students at the School of the 
Art institute of Chicago, one of the leading art schools in 
the country. In addition, several hundred additional Insti- 



tute students completed part of the battery of tests. As a 
group, the art students scored close to the average for 
college students on the cognitive tests used, but differed 
* markedly from college averages on measures of values 
and pel sodality . Mixed results weie obtained when test 
scoics were related to grades in studio ^rt courses and to 
teachers' ratings of the students' originality. Tor example, 
among female students in applied art, there were some posi- 
tive relationships between art grades and perceptual and 
cognitive tests, but among the male students, these relation* 
ships did not hold and were sometimes negative. The 
authors mention a positive correlation of .52 between 
spatial visualization and art grades for female students, for 
the male students it was -.32. In any case the authors 
concluded that traditional academic ability is of relatively 
little importance in art. 

Similar conclusions were drawn by Burkhart (1967) 
who reviewed various studies of the relationship between 
artistic performance in school and academic success and 
measures of intelligence. 

Tinally, Mcdnick (1963) studied 43 University of 
Muhigan and Northwestern University graduate students 
in psychology. They were rated on Taylor's (1963) research 
creativity scale by their research advisors. Neither CPA nor 
Miller Analogies Test scores were related to the ratings, 
although a measure of creative Chinking was. 

e 

Conclusion 

The studies just described present evidence that is in 
general agreement with the evidence of the NMSC and ACT 
studies. Overall, whatever the puipose of the study, and 
however the sample was selected, the results have generally 
been the same, small relationships between academic ability 
and accomplishment in the high school or college years. 

The leaulb of these various studies do not necessarily 
imply the elimination of academic tests and grades as ad 
missions criteria. After all, tests and earlici grades are by 
far the most efficient predictors of ovademic performance 
in college, and academic performance is the most important 
part of students' collegiate ~arccrs. The point is simply that 
colleges interested in other kinds of performance should 
look for evidence of potential for those types of per- 
formance among their applicants. Since earlier accomplish 
ment in an area is by far the best predictor of subsequent 
accomplishment, attention should be devoted to these 
attainments. And this attention is certainly consistent wilh 
the current admissions situation. That is, more and mote 
students delay entry* to college after high school, r leave 
college for a few years, and seek unusual work or oth f cr ex- 
periences during their breaks from their studies. In addi- 
tion, more students work during school and college, and 
more older students are entering colleges. Many of these 
students have .had educationally valuable experiences 
outside the classroom, for which they received no credit. 
Many schools and colleges have also begun a wide Variety of 
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^ o t ff -campus program* of independent study, work experi- . 
ence, public scrvwe, and so on. In this way, may stu- 
dents have opportunities they would not otherwise have 
had to develop and demonstrate their talents. \\ 

Clearly, tests and traditional undergraduate transcripts 
do not provide adequate means of recognition fot these 
kinds of learning and accomplishment. For these reasons, 
it is important to find ways to assess the accomplishments 
of students. 

Another purpose in assessing students' accomplish* 
ments is to select students who are likely to be productive, 
to he creative, to provide leadership, and to make a contri- 
bution to their fields. Many admissions committees, faced 
with large numbers of applicants and dwindling funds, feel 
the need for some way to assess the high;level, noninstitu- 
tion-sponsored accomplishments of students. They Wish to 
have some way of selecting students who will be outstand- 
ing students and who will eventually contribute most to 
society. As the review of research indicates, the most effi 
cient information for predicting future accomplishments is 
data on previous accomplishments. The studies reviewed 
show that the best predictors of future high-level, real-life 
accomplishment in writing, science, art, music, and leader 
ship arc similar accomplishments, albeit at a lower level, in 
previous years. In fact, as with all other behavioral and 
scientific prediction, which is based on the consistency of 4 
the same 01 similar phenomena over tunc, the studies 
indicate that the most effective predictor of high-level 
accomplishment is past high-level behaviors of the same or 
similar typesjjeople who have begi outstanding in a wide 
variety of areas in science, literature, creative arts, and 
public jaffairar have been shown to have had accomplish 
ments in those areas in their high School and college years. 
The institution that wishes to have graduates wI)o will be 
outstanding in their fields in the future might well consider 
the previous accomplishments of their applicants. To date, 
information about past accomplishments has proved to 
be a tar better predictor of high-level accomplishment than 
measures of ability, interests, or personality. As the present • 
. and an earlierreview (Baird 1976) both indicate, scales of 
real-life accomplishments can be constructed that are 
reliable, usable, and seldom faked. They can be used in 
selection decisions in a variety of ways. They seem particu- 
larly useful when there is a need to assess talents somewhat 
removed from academic ability, such as artistic capacity, 
musical skill, ability to write expressively and forcefully, 
dramatic power, and the intuition needed to devise a 
scientific experiment. As these examples suggest, the 
assessment of talent is more difficult in some areas than in 
others, and, consequently, the predictive power of the 
variables will vary from area to area. In any case, these 
measures cannot replace measures of academic talent, they 
simply provide indications of capacity, in and out of class, 
ut other areas that are useful for specific purposes. The 
range of talents that institutionskonsider in their applicants 
could be greatly expanded if they used these measures. 
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Thus, an institution could not onlyusclcct students who will 
get good grades, but students who will be good organizers 
of research, leaders in. political and nonpolitical organi/a 
tions, good writers, and inventive experimenters. 

Another important reason for developing measures 'of 
tin- and out«ofclass activity is that the student applying for 
study has a right to be able to present his or her skills, , 
talefots, and achievements to selection committees. As 
recommended by the College Board's Commission on Tests-, 
students should have some choices in the. picture of them- 
selves that selection officers see. And there is a further 
positive outcome of the inclusion of this sort of informa- 
tion. The students w\o complete a form that asks for their 
personal, accomplishments may feel that they are being 
taken more seriously and that they have had a chaftce to 
present their best side. 

GENERAL SUCCESS AND SOCIOLOGICAL 
STUDIES OF CAREER ATTAINMENT ' 

The studies reviewed to this point have used relatively 
specific criteria of accomplishment within fields or spe- 
cialized areas of activity. It is possible that the generally 
low relationship between these criteria and academic ability 
may be attributed to their specificity. That is, it may be 
that attainment in specific roles or positions is so narrow 
that the full force of academic ability cannot be seen. How 
ever, it is .possible that if one were to look at success or 
accomplishment across positions or occupations, o;ie would 
find that academic ability plays a large role. Perhaps more 
global criteria such as general 'success, occupational status, 
and personal income across a wide range of ability would be 
more appropriate. Although these criteria are obviously 
■more ambiguous and problematical, they are the only ones 
that can apply across a heterogenous group of careers. 

There have been two general categories of studies* long- 
range follow-ups of college students and sociological studies 
of carper attainment. 

Long-Range Follow-Ups of College Students 

Researchers at several institutions have followed up samples 
of their alumni to determine their level of "success" The 
criteria have differed, and the samples have been divided in 
various ways. For example, Jones (1956) examined the 
careers of graduates of tlie University of Buffalo from (he 
classes of 1929 to* 1941 (the average was 20 years after 
graduation) in relationship to the data available for them ds 
college freshmen. Self-reported income and professors 1 
ratings of their success were the criteria. For income among 
the arts and science majors, college grades correlated .34 
(significant) witlj income, test scores .04 (nonsignificant); 
among business majors, grades correlated -04 (nonsig- 
nificant) and tests -.29 (significant) Professors 1 ratings of 
arts and science majors* success, were correlated with grades 
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.30 (significant) and test* .24 (significant), for busmen 
majors, grades were correlated .20 (significant) and tests .18 
(nonsignificant). When income wjs yscd as the criteria within 
the occupational groups of (1) science (including M.D.s), 
02) social service (including law), (3) education, ar.d (4) 
business, college giades were not significantly related in anv 
group. However, tests were positive!) related ih # education 
(.48), and negatively related in business fields (-.23). When 
onl> law>ers were studied, neither grades nor tests were 
related to income. Jones's study suggests some of the 
problems of using general level* of "success" as criteria. 
Obviously, some occupations have higher average incomes 
than others, and entrance to some, such as law and medi 
cine, afe dependent on high grades and test scores. 

Another complexity is suggested by a study by Elder 
(1968). For 63 men, Elder found that IQ scores obtained in 
1038 predicted occupational status (r^AZ) and educational 
level (r-.50) in 1958 for middle class men, but they did noi 
predict cither of these for working class men. In contrast, 
the Strong Vocational Interest Bla^k "occupational level" 
Score did predict in the latter group, but not in the former. 
Elder's study illustrates the importance of an individual's 
social class. Social class influences high school graduation, 
entrance to college, attntion during college, ^id entrance to 
graduate and professional school (Baird 1976). 

For 619 male university graduate^, Lewis (1975) found 
a small, but significant, association between occupational 
success and the Iowa Placement Tests. The University of 
Iowa administered the,, tests to students admitted in the 
apidemic years 1948-49, 1954-55, and 1959-60. Lewis 
followed them up in the late 1960s. Occupational success 
was defined by Roc's (I960) system into three groups. The 
distribution of occupational success for the half lower in 
ability was level 1 (highest), 9 percent, level 2,72 percent, 
level 3, 19 percent. The corresponding figures for the high- 
est quartilc were 24, 66, and 10. For, those between the 
50th and 74th percentile, the figures were 16, 74, and 10. 

Wolfson.(1976) followed up after 25 years 306 women 
who had attended die University of Minnesota during * 
19333b. Jhey were placed into five career categories of 
career acc&niphshnient ranging from "never worked" to "un- 
usually high accomplishment", 29 variables were studied. 
The variables that discriminated most clearly among the voca- 
tional patterns were those related to marriage and cduca-* 
tion. Graduation front college, ^ vocational major, atten- 
dance in graduate school, and unmarried status were most 
characteristic of women with the highest vocational 
patterns. The Minnesota Scholastic Aptitude Test did not 
discriminate among the groups, the Minnesota College Apti 
tude Test did, but the groups were not arranged in any 
meaningful order. The most successful career group had the 
lowest scores. How eve i, it should be noted diat women 
during the 1930s, 40s and 50s probably had to face a good 
deal of sex discrimination, which probably affected the 
results in many ways. 



Nicholson (1970) examined the later success of mem- 
bers- of the Brown University classes of 1950, 1951, and 
1952. "Success" was defined as meeting a number of 
criteria, reputation for academic or research accomplish- 
ment, contribution to the national community, income, 
etc., as judged by a panel of the alumni of each class; 
Similar judgments were made of lists of Brown alumni from 
die same classes who were included in Who's Who and odicr 
national biographies, or whose biographies in die Brown 
Alumni Mun'h) seemed to .meet the criteria. Altogether, 
die 1,105 verbal high scorers (SAT-verbal scores above 
approximately 490) were latcd successful in 26 percent of 
the cascs^the 1,022 verbal low scorers (below 490) were 
rated successful in 23 percent of the cases. Later analyses 
comparing the mean scores of the successful and unsuccess- 
ful groups showed no significant differences on die SAT- 
verbal and SAT-madicmatical scores for cither the alumni 
who were veterans or diose who were nonvetcrans. How- 
ever, among nonveterahs, high school class rank and high 
sJiool Average were higher for tfic successful alumnj. First 
semester college CPA was also higher for die successful 
students in bodi groups. 

These studies obtained inconsistent results, suggesting 
a small relationship between academic ability and success. 
However, diis possibility has to be weighed against die 
effects of social class, years of education, type of occupa- 
tion, and degrees obtained. Is there any wa^-to sort out 
these influences? 

Studies of Occupational Attainment 

Probably die most frequendy cited evidence about die 
relationship between, academic ability and , occupational 
attainment is Harrell and Harrelfs (1945) study of die , 
ability of World War II enlisted men who had been in differ- 
ent prcinduction occupations and Thomdikc and Hagcn's 
(J959) study of the later occupations of 10,000 World War 
II Air Force cadets. The Harrell and Harrell study reported 
the mean, median, standard deviation, and ran&c of Army 
Central Classification Test scores by male inductees' civilian 
occupations. For example, they showed diat accountants 
averaged 128,1, with a range of scorqs from 94 to 157, 
mechanics averaged 106,3, widi a range from 60 to 155, 
and teamsters averaged 87.7, widi a range from 46 to 145. 
Although these results suggest a substantial general rela- 
tionship between jest scores and occupational attainment, 
dicy arc limited by die fact that they arc retrospective, i.e., 
die scores of various occupations may have been the result 
of educational or other experiences rather than differences 
in innate ability. 

The Thomdikc and Hagcn results deal widi some of 
these problems by obtaining die test data prior to data 
about subsequent occupations (12 years later). In addition, 
Thomdikc and Hagen used five scores general intcllcc 
tual, numerical fluency, visual perception, mechanical, and 
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psychomotor. These "sejres flowed them to construct 
profiles for the individuals in each occupational group. For 
example, the cadejts who eventually became lawyers hjul 
abovc«average scores on general intellectual capacity and 
numerical capacity, but had below-average scores on the 
mechanical and psychomotor tests. 

In general, the scores of cadets in different groups were 
about as expected. For example, the cadets whojater were 
college professors, engineers, physicians, and scientists had 
scored high on the general intellectual score composites. 
Those who later became managers, pharmacists, treasurers, 
accountants, and securities salesmen scored high on the 
numerical composite. Those who later became architects, 
artists, surveyors, and radio-TV repairmen scored high on 
the visual perception composit Those wfto later became/ 
airline pilots, carpenters, electricians, and wood-carvers 
scored high on the mechanical composite. Cadets who later 
became appliance mechanics, machinists, firemen, and 
plasterers scored high on the psychomotor composite. Of 
these, the general intellectual composite seems closest to a 
measure of general academic ability, and the distribution 
of later occupations onjfte measure is close to what one 
would expect. Foi* example, the highest-scoring groups 
♦included cadets who later became engineers, physical 
scientists, college professors, social scientist^ physicians, 
treasurers, office machine mechanics, and architects. The 
groups that were very close to average included cadets who 
later became buyers, artists, clerks, draftsmen, lab techni- ■ 
cians, credit managers, and real estate salesmen. The towest* 
scoring groups included cadets who later became produc- 
tion-line assemblers, earth itfovers, crane operators, welders, 
linesmen, painters, pumpmen, and bus and truck drivers. In 
general, Unjsc groupings mirror the usual status and income 
rankings of the same occupations. 

Thomdike and Hagen also sought to predict success 
within occupations, defined as reported income, vertical 
pwgress within the occupation, stability, in the occupation, 
work satisfaction, personal sense of success, number of 
individuals supervised, and leng\h of time spent in the 
occupation. In this case, however, the number of significant 
correlations between test scores and the criteria was close 
to the number expected by chance. For example, of the 
385 correlations between the composite scores and income, 
for 77 occupationalVroups, only 24, or 6.2 percent were 
significant at the .05 lend. Thomdike and Hagen concluded 
that the null hypoUiesis^med adequate to account for 
their results (p. 45). 

They noted, however, that several factors worked 
against their finding significant validity coefficients within 
-occupations. Especially important was the fortuitous nature 
of the employment situation. First, they pointed out that 
the criteria were imperfect, describing many of the same 
difficulties noted in earlier pages in this review. Second, 
their predictors included only tests of ability and a brief 
biographical form. Measures of persunality, interests, social 
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skills, and the like were not included. Third; their sample * 
was preselected, representing roughly the top half of a high 
school graduating class. Finally, the heterogeneity of work 
within occupations makes prediction difficult. A lawyer ot 1 
an accountant may have a small practice in a small town of 
may be employed as a senio r official in a Wall Street firm- 
situations that are probably more due to personal prefer- 
ences and personality than to differences in ability. 

'In any case, Thomdike and Hagen present strong • 
evidence that ability test scores are related to the occup4»-%*>> 
tional outcomes of individuals in expected ways. 

As impressive as these studies arc, they have been^iwes- 
tioned because they do not contfol^for tlic social class 
background of the subjects, the influence of education, 
and othe'r personal characteristics that may affect the 
results. Tint is, do the test scores reflect basic abilities thdt 
help to cause the differences in occupational attainment, or 
are the test scores the remit of favored social position, 
educational opportunities, etc.? 

Analytical Sociological Studies 

In an attempt to answer this last question, a number of 
sociologists have analyzed the attainment process. They 
have attempted to estimate the influence of social class, 
ability, education, family influence, and other variables on 
the occupational status or income attained by people in the 
United States. s /> * 

The sociological studies that have attempted to analyze 
the achievement process have used a variety of samples and 
measures. The criteria have generally been occupational 
status (especially as defined by Blau and Duncan 1967) and 
income. Occupational status means the esteem in which the 
occupation is held. For example, a physician would obtain 
a high score, a garbage collector a low score. In other 
analyses, occupations are grouped into categc ; .s such as 
professional, high managerial, etc., and the category is 
assigned a score. Income'has been treated as a linear variable 
or as a transformed variable, it has sometimes referred to 
salary alone and at : othe? timesJo total income. However, 
whatever the details of^the definitions, the basic constructs 
of occupational status and income are the same and reason- 
ably clear. 

The various studje? have examined different career 
periods and have obtained different data at different times. 
However, whatever the differences, the basic technique that 
has been used is path analysis. This method attempts to 
create models of the influence of one variable on another 
.and produces estimates of the amount of, that influence 
that may be due to.another intervening variable. This is 
much more informative than simple zero-order correlations. 

A great 4eal of his research shows that people who 
6core high on tests oi acacLMnic ability tend to obtaftf higher 
status jobs and earn more money than people who score 
lowei. However, people with different social viewpoints 
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interpret this finding differently . Liberal views emphasize 
% the role of social class in determining scores and Uic 
presumed "biases" in the tests themselves (e.g., Block and 
Dworkin 1976, Bowles and Gintis 19^6, Kamm 1974). 
More conservative views emphasize the importance of 
academic ^ability per se and the, necessity of so-called 
"midt^ class skills values" for a technological society. 
Crouse (1979) has reviewed the empirical results bearing on 
the effects of academic ability, by reanalyzing the data 
from Project Talent, &well and Hauser*s (1975) sample, 
the Equality of Educational Opportunity sample (Alex- 
ander,* Eckland, and Griffin 1975), the Kalamazoo sample 
(Olneck 1976), the SRC sample, and the Armed Forces 
, Qualifying test sample (Jencks and Rainwater 1977). 
Crouse attempted to control for such variables as parental 
social glass and to af least estimate the role of ability in 
influencing the extent to which.adolescents are carolled in 
college preparatory curriculums, earn high grades, receive 
k * parental and peer encouragement of their college plans, and 

receive the attention of their teachers. Crouse concludes 
that even after controlling for social class, curricular place- 
ment, etc., more than half of the observed correlation 
between test scores and educational attainment remains. He 
leaves open the question as to whether this is due to merit 
or to causey that are "unfair** to adolescents with low 
ability. Examining the relations^ between ability and 
\earned occupational status, Crouse finds that there is an 
important effect of ability, but that "60 to 80 percent of 
the effect is explained by die amount of schooling the 
individual attains .... Men who fail to convert their ability 
advantage into additional schooling do not havpmuch of an 
occupational advantage over men with Iower-scores." 

The effects of ability on earnings were tliat: (1) even 
controlling for family background; a 15-point test-score 
difference is associated with a 17 percent difference in 
annual earnings in a sample of brothers; (2) the effects of 
test performance on earnings increase with age; (3) sd- 
^ though differences in earnings are partially due to educa- 
tipnal attainment "nearly two-thirds of the effect of test 
scores on earnings is independent of men'* education .... 
A 15-point test-score difference between men with the 
same amount of education is associated with as much' as a 
14 percent difference in their annual earnings;" (4) "the 
effects of test performance on earnings are not very large 
relative to the overall earnjftgs gap between the rich and 
the poor in general.*' Laterf *ncks et al. (1979) noted that 
the result of their Who Gets Ahead? study ". . . suggests 
that the correlation between adolescent test performance 
and adult economic success is probably somewhat higher 
than Inequality implied ... our results do not, however, 
suggest that adult test scores are more closely related to 
adult economic success than Inequality claimed.*' 

These results have been summarized by Seligman(l981) 
as follows: . 

Take, for example, the relationship between l.Q. and 
income. In its purest form that is, after subtracting out " 

♦ 
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the effect* on income of such factors as age, region of 
the country, and the state of the economy at the time 
the data were collected the "coefficient of correlation" 
is estimated to be quite high, around 0.6. That number 
signifies a strong and positive, although far Trom per- 
fect, relationship between l.Q. and income. The square 
of the number, which is .36, is the so-called coefficient 
of determination- which tells us that 36% of the varia- 
tion in income reflects l.Q. differences. Other relation- 
ships between l.Q. and income are reported in the 
second Jencks study. It notes, for example, that among 
otherwise identical individuals, increasing l.Q. scores by. 
about 15 l.Q. points increases expected lifetime earn- 
ings by 2(KT to 30^. A 15-ppint different in brothers' 
scores is associated with a 13.S" difference in their 
earnings, assuming that they have the same amount of 
schooling. So you have to conplude that above-average 
I.Q.s mean you'll probably have above-average incomes, 
and vice versa. 

Similar probabilistic statements might be made 
about your occupational status. The measurement of 
status, a major product of the socrology industry, is 
rooted in surveys in which respondents have ranked 
many different occupations by the prestige they felt 
was associated with each. Tor cx.an}plc, on the famous - 
Duncan Index of Occupationat^iS^atus, the rankings 
proceed from, the zero given to laborers in tobacco 
plants* to figures in the 90s for, say, judges. While l.Q. is 
probably the single best predictor of income, educa- 
tional' level is best for occupational status. Who Gels 
Ahefrtl? estimates that high-school graduates outrank 
elementary-school graduates by 1 1.6 points and aie in 
turn outranked by college graduates by 25.6\noints. 
(p. 66) ; 

The specific details of the studies reviewed by Crouse 
and Jencks and other studies qrc too technical and numer- - 
ous to go into jn this review, but the general consensus 
about the role of ability is that itsc/ir<?t7 effects, especially 
on income, are consistent but moderate. Most of tlie effect 
of ability is in its "indirect** influence on years of educa- 
tion, which then influences attainment. That is, high" 
academic ability allows one to obtain greater amounts of 
education, which in turn allows one entry to higher-status 
occupations and thereby to obtain liighcr incomes. Put 
another way, high-ability people without a good deal< of 
education are much less likely to have high occupational 
attainment than high -ability people with a good deal of 
education. Even moderately able people with many years of 
education are more likely to havp high occupational attain- 
ment titan high-ability people without many years of educa- 
tion. The mechanism of education-why it should have such 
effects— i& a matter of controversy. The traditional view of 
educators is that people are taught general conipetencies 
that are broadly useful in occupations, and, in some cases, 
specific skills that lead to' success in a specific area. Some 
radical critics, on the other hand, claim that schooling is 
simply a matter of credentialing and gatekeeping; that is, 
it is' the high school diploma, the college degree, or the 




professional certification that matters, nut the learning of 
skills thafare really es&ntial for the work. 

The xole of grades tends to be similar to that of aca^ 
denuc ability. Higher grades allow individuals to obtain, 
greater amounts of education, which in turn, leads tohigher- 
level occupations and higher income. The direct effect of 
grades on occupational status and income is fairly small, 
i 

Conclusion 0 

In sum, academic ability plays two roles in the process of 
attaining status and income. The first is a direct effect" 
Jhe higher one scores on^n academic ability test, the higher 
the attainment. The second role is to increase the probability 
that the individual will obtain education.' the higher one 
scores on an academic ability test, the more years of educa- 
tion obtained and, subsequently, the higher the level & 
attainment. The mechanism by which this, latter effect 
takes place is a mattet of differing opinions. One View fs 
that the tests are simply surrogates for class-related variables 
that permeate our educational system. Another is thaj tests 
measure the capacity to profit by instruction. Certainly the 
tests measure abilities and skills necessary'to do well and to 
advance in .the educational system. Furthermore, studies of 
the extent to which grades and academic ability tests 
merely reflect social class biases indicate that both grades 
and tests are v esscntially "ctass-free." 

In sun\ there is much evidence that more. academically 
able people are more "successful," in terms of economic 
and occupational attainment than less academically ablK 
people. Many otM* factors affect success, of course, so the 
relationship is not perfect. However, for academically able 
people to attain: success, they have to make i)se of their 
ability by attaining education. Without education it appears 
that raw academic ability will not lead to nearly as high 
levels of success as with education. 



THE TERMAN STUDIES OF THE GIFTED 

In 1921, Louis Terman of Stanford University began a 
study which is still underway. Using the. Stanford-Binet 
Intelligence Test (and other tests in a few cases), he and his 
coworkers identified a group oM\528 children, from grades 
3 to 12, most of whom had IQ scores of 140 or above. This 
group has been followed up intensively for njore ilian 50 
years. In the last published results (Oden 1968), the group 
had reached an average age of 49.5 and a small proportion had • 
died. Thus, the group had clearly had opportunities to ' 
demonstrate their capacity for achievement. The reports of 
the surveys show that the group had attained a very high 
average level of education, 69 percent had finished college, 
9 percent had earned doctorates, 8 percent had obtained 
law degrees, and 5 percent held M.D;s. The reports show 
that their incomes and occupational status were far above 



the average of the population. Their social contributions 
were summarized by Oden in 1968: 

In spite of their vocational achievement*, the majority 
of gifted men have fojind time to participate in civic 
and v community affahrs. The most frequent activity for 
men, reported by 31 per cent, has been participation in* 
youth welfare programs including Boy Scouts, Little 
League, - M Y M recreational activities, Big Brother, and a 
siirpJar groups. Close to 20 per cent have served on 
school boards, city or 'county planning commissions, 
city councils, Grand Junes, boards of directors of 
philanthropic and welfare organ^ations, and in various 
capacities inducting fund-iaismg in other community - 
and philanthropic programs. A number ot men have 
won public recognition and honor foi their eontribu- • 
tions. Among these are 21 men wljo have received such 
citations as Citizen of the Year or Man of the Year, Dis- 
tinguished Civilian Service Award, Distinguished,Servicc 
to Boyhood medal. ' At least four men have been ap- 
pointed at the state level to a Governor's Advisory 
Board and eight men have served on national advisory 
committees or councils. ■ f 

Although many of the men have* manifested con- 
siderable interest and activity in. political as well as 
civic affairs and community life, the number who have 
* sought election to public office is not very great. One 
man formerly m the state legislature Aas later elected to 
a high office in the executive' branth of the state govern- 
ment. Tive men have been elected to judgeships four ■ 
Superior Court and one Appellate Court. At the locat 
level, at least three men Jiave been elected mayor of 
their cities. The list of political 'offices "held includes 
15 to JO men who have been elected to county or state ^ 
central committees of the. Republican or Democratic * 
party, as well as several delegates to the national con- 
ventions ot their party. Others have held office in local 
Democratic or Republican clubs. Among efcher political 
activities arc a hundred or more men who report service 
as precinct workers, clRtidn board officers, and a great 
deal ot miscellaneous party work on behatf of the can- 
. didate or party of their choice at election time. In addi- 
tion to the men who have held elective public ottice, 
there arc also several who have been unsuccessful can- 
didates for office. These include one who ran for a scat 
in the United States Senate, one candidate for a Superior 
% Court judgeship, and oife who ran for the position of 
district Attorney . Three men have competed unsuccess- 
fully for election to their state legislature, and several 
others have been defeated in a try for election to local 
office. 

The most outstanding positions in public service 
held by the gifted men are appointive. Among tl|esc is 
the* head of one of the most important departments, 
^ next! fo 'cabinet level, m the federal government. Others 
holding high level appointive positions in the federal 
government include two ambassadors and five men in 
executive positions in various divisions of the State 
Department. Still others arc officials in the Federal 
- Reserve Board, Dcpartnjpnt of Justice, Atomic Energy, 
Commission, National Aeronautical Space Administra- 



tion, ami Vetewns Administration. Three men are 
* deigned to the United Nations in charge of programs in 
foreign countries and two men are on the staffs of 
United State* senators as special advisers, (pp. 20-2 1 ) . 

Similarly, Oden summarizes the writing, professional, 
and scientific accomplishments of the group: 

» 

The men range from top-ranking members ol university 
faculties, famed scientists, men distinguished in the arts 
^and humanities, high level corporate officials and execu- 
tives, to semiskilled occupations. The group is prelt> 
well 'concentrated on the upper rungs of the vocational 
ladder with only a few on the lotoer steps. There is no 
evidence that the men with Jcwci Vocational achieye : \_ 
merits are any less able intellectually than .those who 
have reached high place^. In some instances their Vpca- -* 
tion was determined by educational or occupational , v 
opportunities, in others by health, and in still others it 
was a matter of deliberate choice of a simple, less cony 
petitive way of life. 

The list of distinctions and honors that have been 
won is a longpne. Three men have been elected tQ the 
National Academy of Sciences and two to the American 
Philosophical Society. STix are included in International 
Who's Who. 46*in \tho's Who in America, 10 in The 
Dictionary of American Scholars, and 81 in American 
Men of Science. There are many additional listings in 
regional and other specialized biographical volumes. 
The achievements of these men also include an impres- 
sive number of publications. Some 2500lrticles ,and 
papers and more than 200 books and /monographs in 
the., sciences, arts, and humanities have been published fc 
and at least 350 patents granted. Miscellaneous articles 
(technical, travel, hobby, etc.) number around 350. 
Other publications include close to 400 short stories, 
55 essays and critiques*, and a shiall amount of poetry 
and several musical compositions. Not included in the 
foregoing count are tlje professional output of editors 
and journalists or the many radio, TV, and motion pic- 
ture scripts that have been authored. Both .architects 
and artists as well as several avocational photographers 
have had their work chosqn for exhibit. In addition to 
two men, one of whom is a^professor and chairman of 
the art department of a large university and also an 
artist of consider Wle distinction, and the other a painter 
and teacher of private classes in art, 10 men employed 
in other fields are also gifted painters who devote their t 
leisure time to art. Several -oif these men, most notabjy , 
two high school teachers, have produced some dis- 
tinguished works which have been shown in galleries 
'and won prizes and sales for the artists. Musicians are 
less' frequent than artists among the men; there t are, 
however, three musicians on university faculties, two as 
heads of the department of mu^ic. Four men are per- 
formers or choral directors in the field of entertainment, 
(pp. 19-20) 

Although these accomplishments are impressive, un- 
fortunately their significance is difficult to determine. First, 
one cannot compare these accomplishments with those of 
aay other group. Although the reports meticulously record 



the percentages and frequencies of the groups* responses to 
opinion items, tjieir ratings of their marital satisfaction, and 
so forth, there fs>no similar detailed information about their 
accomplishments. In fact, the only information provided 
about their accomplishments is contained in the paragraphs 
just quoted. There ate no tables, frequencies, percentages, 
averages, or any numerical information other than the 
paragraphs. However, even with such information, there 
would need to be comparable data on the accomplishments 
of individuals with similar educations and ages but wilfcji 
lower scores on the intelligencctest. Without such compara- 
tive information, there is simpl^ no way to know whether 
the highly intelligentfTerman group has achieved more than 
other similar i groups whicji differ only in intelligence scores. 
\ Furthermore, as Oden has suggested-, it is difficult to 
disentangle the role of intelligence from the role of social 
class in the accomplishments of the group. % 

In the total. picture, the variables most closely associated 
with vocational success are a home 'background in 
which the v parents place a high value on education, en- 
courage independence and initiative, and expect a high 
level of accomplishment; good mental health and all- 
round social and emotional adjustment; and the posses- 
sion of certain traits and characteristics of personality, 
(p. 92) 
\ 

However, there are some suggestive comparisons in the 
Terman study, those of "successful 11 and "unsuccessful" 
members of the group. Oden (196$) reported a large num- 
ber of differences between the two groups denoted as "A" 
and "C." The A«group members were successful in their 
professions, their private lives, and their adjustment to life. 
The typical "A" individual was a productive and lively pro- 
fessional. The C group included people living off estates and 
doing nothing else, alcoholics, and perennial students; but 
more commonly, they were in skilled trades and clerical 
positions. Although there was a slight difference in child- 
hood intelligence test scores, the largest differences were in 
several other areas. Fir^, the A parents were of higher 
social class than ihe C parents. The A patents had b.etter 
education; the A fathers were more* often professionals 
and had more community and professional honors. The A 
homes had more intellectual resources, such as large li- 
braries. The Cs more often came fiom broken or divided 
homes, and homes where money for the children's educa- 
tional costs was more of an. issue than in the A homes. The 
A parents gave n\ore encouragement to their children's 
initiative, independence 4 , success in school, and desires to go 
ta college. The*As graduated from college in greater num- 
bers than the Cs '(92 to 40 percent); they also achieved 
many more advanced degrees. Finally, the subjects liad 
been rated by their parents and teachers as children in 1922. 
Th^results showed the As to rate higher on, "prudence "and 
forethought," "selfconfidence," "will power and persever- 
ance," and "desire to excel." In 1940, the subjects were 
rated again, this time oy themselves, their wives, and their 
parents. The As were rated higher than the Cson "integra- 



f tiun toward goals/* -"pcrbcverance" 4, sclf-confidenee, M and 
"absence of infcnority feclihgs." The subjects rated them- 
selves again in 19S0 with the same results, except for the 
•last category. They were also rated by field workers in 1940 
and 1950. The variables ^vere sclected^KTcover areas not 
covered by die earlier ratings. The ratings wjiieh best dis- 
criminated the groups in 1950 were, in descending order, 
originality, curiosity, poise, alertness, appearance, atten- 
™ ' ttveness, attractiveness, and speech. 

Perhaps the most striking aspect of these results is the 
expectedly small role of intelligence scores, compared to 
the influence of social class, educational level attained, and 
personality traits reflecting personal stability, social im« 
pressiveness, and ambition. 

In short', the typical member of the sample who was 
chosen for his or her scores on the Stanford-Binet in the 
1920s has turned out to be a healthy, prosperous middle- 
class professional who, like most people, is not a genius. 
In any case, their accomplishments cannot be reliably 
assessed until there is comparable information about the 
accomplishments of individuals who obtained the same edu- 
cations but who had lower intelligence scores. Furthermore, 
the results of die Terman study only indirectly bear on the 
question of the overall relationship of academic ability to 
high-level accomplishment, because the sample is so ex- 
treme. 

As Keating (1975) has pointed out in an^rticle.on pos- 
sible sampling bias in die Terman study, the sample is even 
more extreme dian 140-plus. If a normal curve of intcl* 
hgence were used, the mean IQ of a sample above 140 
would be 145; Terman's sample averaged 151, a difference 
significant at the .001 "level. Thp sample includes consider- , 
, ably fewer cases than expected in the-140-to-145 zone and 
many more than expected in the 146-to-155 zone. The 
mean of the samgle is at a score attained by fewer than 
1/10 of 1 percent of die sample. Thus, even if Uiere were a 
small correlation between accomplishment and intelli- 
gence, a group selected at such an extreme leyel of intelli- 
gence would be expected to show considerable achieve- 
ments, simply because of die selection ratio (Taylor and 
Russell 1939). 

In sum, it is difficult to assess die relevance of die 
Terman study to the question of the- Relationship between 
academic ability and accomplishment. The information on 
their accomplishments is not fully recorded. There is no 
comparative information on a similar sample of lower IQ. 
The sampu, was selected at such an extreme leveffhat gen- 
eralizations are hazardous. However, it is clear tliat die 
persons included in die sample accomplished a good deal, 
and 4t is hard to argue diat their accomplishments are not 
due, in large part, to dieir academic ability. 

, ' SUMMARY AND DISCUSSION 

What can we conclude about the relationship between 
academic ability, academic success, and high-level real- 
id 
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life accomplishment? Perhaps die most reasonable position 
is that academic talent is related to high-level accomplish 
pients in conjunction with several odier variables. 

The Berkeley studies 'found essentially no differences 
between die academic ability oV intelligence test scores of 
. die creative and uncreative groups, die major differences 
between die groups seemed to be personality measures. 
However, IQs below 120 were seldom fdund among the 
groups of scientists, mathematicians, architects, and writers, 
which suggests tliat a. certain level of academic ability is 
needed to master these Jields. 

The Terman longitudinal study shows that individuals 
with 'high Stanford-BLiet test scores accomplish a good deal, 
although the level of accomplishment is somewhat uncer- 
tain because of the ambiguities of the reports of the proj- 
ect. The comparisons of "successful" and "unsuccessful" 
members of the sample demonstrated essentially trivial 
differences in test scores, : but showed the importance ,of 
personality in this very highly selected group. 

The studies of scientists, engineers, and physicians 
showed scattered correlations between accomplishments, 
and academic ability scores and grades, which may not be 
surprising considering die diversity of criteria and samples. 

*ilie studies of managerial and business success, al- 
diougli sometimes done widi sophistication, have to be 
interpreted cautiously. However, within diese samples, 
there seemed to be low relationships between accomplish- 
ments and die individual's estimated ability scores. The 
studies of particular occupational settings arc a mixed 
group using a wide range of criteria; but, in general, dicy . 
suggest some link between academic ability and acconv . 
plish meats. 

The National Merit Scholarship Corporation and the 
American College Testing Program studies and the othc- 
studies of student accoirtplishment are limited by the fact 
that they were conducted among college applicants and col- 
lege sfudents, so the level of accomplishment may not be as 
bights that in the other studies reviewed. However, there is 
no reason to believe tliat the relationship between academic 
talent and accomplishment should be greatly different for 
college students than for adults. The accomplishments are 
* real ones, even if they are at the college level. The American 
College Testing samples represent a broad range of talent. 
These studies found low positive relationships between 
academic talent and accomplishment., / 

The studies of general success and the sociological ^ . 
studies showed some direct effects of academic ability and 
grades on occupational status and income. Most of the over 
all effects of ability and grades are due to the greater 
amounts of education they allow. These results lead to 
questions about the meaning of education and degrees; but, 
in general, they suggest that academic ability and academic 
performance affect academic success and progress, which 
in turn lead to occupational opportunities. 

The meaning of these results may become clearer if we 
use an analogy from sports. Let us say we have a measure of 
height, collected at some time in the school years. A 
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student who is tall would be more likely to do well 
in a sport such as basketball than a shorter student. 
However, the student would not do at all well without at 
least some training in basketball. 'Clearly, excellence in 
basketball is also influenced Jby the student's other quali- 
lies coordination, strength, balance, competitiveness, etc. 
All of this may be considered as analogous to the relation- 
ship between measures of academic. ability and oeeupa* 
tional attainment. Like height in basketball, academic 
ability is important in occupational Attainment; but, like 
being coached in basketball, education plays a vital role in 
the attainment process. Again, occupational attainment is 
also influenced by other factors, such as motivation, in- 
ventiveness, special talents, etc. To return to basketball, it is 
alsu Jeai that good coaching can sometimes uvcicuiuc 
deficiencies in height. Likewise, good education can help a 
•person with low to moderate academic ability reach high 
levels, of occupational attainment. Also'notc jhat the more 
effective the coaching, the lower the correlation between 
height and success in basketball, and the more effective the 
education, the lower the correlation between academic 
ability and occupational success. 

One tieud which met its further investigation was fojind 
in seveidl of the studies, which indicated* that abilities or 
skill* of importance in particular fields are more predictive 
of success in those fields than tests of general academic 
ability. Tor example, in the NSF studies, tests of specific 
knowledge in the fields of advanced stud> the applicants 
planned to pursue predicted later accomplishment bettei 
than the more general GRL tests. In several of the indus- 
ttial studies, tests designed for the professions that were 
the topic of the study also predicted later accomplishment 
better than tests of general academic ability. Several othei 
findings wetc similar, such as the Holland and Richards 
results showing that, in certain areas, achievement measures 
did help predict rionacademic accomplishment. For exam- 
ple, a test of Lnglish u*age and knowledge piedicted wilting 
achievement, but a general composite measure did not. 
Several studies in business sllowcd that second-year business 
school grades were related to managerial success, but ad- 
missions tests were not. All of these results can b« inter 
pietcJ as showing that ability and training which hdirectly 
telatcd to a field does predict later accomplishment in the 
field. Of course, the elements of achievement in many fields 
du mj complex that no test could assess them all. Perhaps 
this avcount\for the consistent result that biographical in 
formation about past accomplishments in a given area 01 
about activities sunilai or preliminary to accomplishment in 
that aica arc the best piedtctors of later accomplishment 
(Baud 1 97o). Biographical information can assess a broadei 
idnge of relcvent behavior more efficiently than can a test. 
In anv case, general academic ability nieasures*do not have 
the specificity of these measures, and they arc designed to 
predict general academic success across many diffcient 
kinds of programs. 
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Convergent Thinking 

Figure 1. Fan-Shaped Distribution of Relationship 
between Convergent Tliinking and Creative 
Behavior 

Beyond the nature of the tests developed to assess 
general academic ability, there is another possible explana- 
tion foi the iclatively low leLilioj^ship b$tvvc6q academic 
ability and accomplishment. GnlTfoj-d (196^) summarised a 
consideiable number of studies that reported scattcrplots of 
the relationship of scores on "convergent" and "divergent" 
ability tests which showed .a* typical shape, as shown in 
Figure 1 . V 

In Guilford's system "convergent" abilities include 
academic ability, whereas "divergent" abilities include^ 
vaiious capacities that Guilford Relieves are related to 
cieative accomplishment. Overall, latere was a general, 
small, correlational relationship between convergent and 
divetgent ability tests. Few individuals wi^o were quite low 
on the. convergent ability tests scored high v^n the divcigcnt 
ability tests. Although some individuals who Scored high on 
a test of convergent thinking also scored high^n tests' of 
divergent thinking, many did not. However, the main point 
is that the highest scoicimoii incatuie* of diveigeiit think* 
tug also tended to have high Scores on measures of conver- 
gent thinking. * \ 

Thus, although there may be low overall correlations 
between convergent and divergent thinking, there may bc\^ 
critical relationship when the entire spectrum of ability is 
studied. For example, if we limit the distribution to those 
who are college applicants scoring (above point A, for 
example), the correlation Aould be much lower. And if we 
limit the distribution to college graduates (above poii^Bk 
foi example), the correlation becomes even smaller, and if 
we limit the distribution to graduates of graduate or pro* 
fcssional school (above point C, for example), the correla- 
tion would be close to zero. It is clear that, within any of 
these groups, any further selection on measures of conver- 
gent thinking would Aot increase the porportion of people 
who demonstrate creative bchavio;, although the average 
incidence of creative behavior would be higher than that of 
groups scoring lower on measures of convergent thinking. 
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It Guiliord's idcd^ die accurate, it would-be virtually 
impossible to demonstrate a strong relationship between 
academic ability and creative or high-level accomplishment 
within any occupational or educational group. It may also 
be difficult to demonstrate a strong relationship across all 
levels of academic ability, although the highest levels of 
accomplishment would be Expected among people with the 
highest academic ability. It should be noted that high aca- 
demic ability is no guarantee of high-level attainment. 

This point is similar to that made by observers such as 
Spaeth (1^76) who notes that 

It should be pointed out that any argument c^mgalow 
correlation between educational attainment or low test 
scores and job performance is invalid evidence of the 
ineffectiveness ot cognitive variables as determinants of 
occupational status. Since educational attainment pro- 
vides ent$ to an occupation and since the incumbent 
oi an occupation is accorded the prestige of that occu- 
pation on the day that he enters it. such a low correla- 
tion is clearly a matter of false partiailing (Gordon, 
1%8). That is. analyses of job performance must take 
into account the process by which job incumbents 
gained entry to their positions. It is all too common for 
analyses ot persons in particular occupations to view 
the process as if entering an occupation were not the 
culmination of years of socialization, training, and 
selection. This oversight leads to the interpretation of 
correlations observed within occupations as if they were 
zero-order correlations pertaining to broader popula- 
tions. 

In sum, it appears that academic ability is clearly a pre- 
requisite to higher levels of education and thus a pre 
requisite to entrance to various high-level occupations. 
People who enter these various occupations tend to he 
similar m a number of otlv talents and traits as well as m 
academic ability Therefore, it is difficult to distinguish 
among people who tend to share common peisonal charac- 
teristics, educational experiences, ard professional values. 
Although a certain level. of academic ability is\rcquircd for 
entrance to the training demanded of people in the occupa- 
tion, it would be very difficult to demonstrate a high corre- 
lation between ability and success within these occupations. 
In- fact, considering these difficulties, some of the correla- 
tions repotted in this review may be surprisingly high. The 
full force of academic ability can be seen only across 
occupations, and ability levels. These studies show that 
jeddenik ability is related to educational and occupational 
attainment, broadly defined. Of course, the same studies 
show that a host of other variables are also related to attain 
ment, which may tend to mute the- direct effect of aca- 
demic ability. In general, however, academic ability docs 
appear to- play a significant role in accomplishment across 
tvCtipatioiis. 
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